-- Logs begin at Tue 2022-06-28 02:18:03 UTC, end at Tue 2022-06-28 03:31:48 UTC. -- Jun 28 03:03:00.587927 dv-cinder-846842-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 28 03:03:00.597432 dv-cinder-846842-5-smb devstack@keystone.service[80334]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 28 03:03:00 2022] *** Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: nodename: dv-cinder-846842-5-smb Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: machine: x86_64 Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: clock source: unix Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: pcre jit disabled Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: detected number of CPU cores: 4 Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: current working directory: / Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: detected binary path: /usr/bin/uwsgi-core Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: your processes number limit is 47680 Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: your memory page size is 4096 bytes Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: detected max file descriptor number: 2048 Jun 28 03:03:00.599493 dv-cinder-846842-5-smb devstack@keystone.service[80334]: lock engine: pthread robust mutexes Jun 28 03:03:00.600242 dv-cinder-846842-5-smb devstack@keystone.service[80334]: thunder lock: enabled Jun 28 03:03:00.600242 dv-cinder-846842-5-smb devstack@keystone.service[80334]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 28 03:03:00.600242 dv-cinder-846842-5-smb devstack@keystone.service[80334]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 28 03:03:00.643621 dv-cinder-846842-5-smb devstack@keystone.service[80334]: Python main interpreter initialized at 0x55f4853049c0 Jun 28 03:03:00.643621 dv-cinder-846842-5-smb devstack@keystone.service[80334]: python threads support enabled Jun 28 03:03:00.643621 dv-cinder-846842-5-smb devstack@keystone.service[80334]: your server socket listen backlog is limited to 100 connections Jun 28 03:03:00.643621 dv-cinder-846842-5-smb devstack@keystone.service[80334]: your mercy for graceful operations on workers is 90 seconds Jun 28 03:03:00.643940 dv-cinder-846842-5-smb devstack@keystone.service[80334]: mapped 403077 bytes (393 KB) for 2 cores Jun 28 03:03:00.644013 dv-cinder-846842-5-smb devstack@keystone.service[80334]: *** Operational MODE: preforking *** Jun 28 03:03:00.644300 dv-cinder-846842-5-smb devstack@keystone.service[80334]: *** uWSGI is running in multiple interpreter mode *** Jun 28 03:03:00.644300 dv-cinder-846842-5-smb devstack@keystone.service[80334]: spawned uWSGI master process (pid: 80334) Jun 28 03:03:00.644500 dv-cinder-846842-5-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 28 03:03:00.645585 dv-cinder-846842-5-smb devstack@keystone.service[80334]: spawned uWSGI worker 1 (pid: 80341, cores: 1) Jun 28 03:03:00.645585 dv-cinder-846842-5-smb devstack@keystone.service[80334]: spawned uWSGI worker 2 (pid: 80342, cores: 1) Jun 28 03:03:00.645585 dv-cinder-846842-5-smb devstack@keystone.service[80334]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 28 03:03:06.018622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:03:06.018622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: from cryptography.utils import int_from_bytes Jun 28 03:03:06.019469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:03:06.019469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: from cryptography.utils import int_from_bytes Jun 28 03:03:06.019886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:03:06.019886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: from cryptography.utils import int_from_bytes Jun 28 03:03:06.019993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:03:06.019993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: from cryptography.utils import int_from_bytes Jun 28 03:03:06.067153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 03:03:06.067324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 03:03:06.067518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] command line args: [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 03:03:06.067667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 03:03:06.067667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 03:03:06.067813 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 03:03:06.067881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] command line args: [] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 03:03:06.067945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ================================================================================ {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 03:03:06.068150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 03:03:06.068272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] admin_token = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.068346 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ================================================================================ {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 03:03:06.068421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] config_dir = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.068565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] admin_token = **** {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.068651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.068713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] config_source = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.068777 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] config_dir = [] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.068904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] debug = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.069057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.069138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.069315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] config_source = [] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.069315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] debug = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.069445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.069505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.069589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.069734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.069810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.069880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.070070 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.070179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.070254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.070364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.070609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] log_config_append = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.070720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] list_limit = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.070791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.070851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] log_config_append = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.070909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] log_dir = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.070972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.071031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] log_file = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.071099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] log_dir = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.071164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.071238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] log_file = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.071430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.071526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.071652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.071742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.071904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.072015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.072085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.072154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.072228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.072303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.072502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.072630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.072717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.072785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.072928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.073012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.073130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.073215 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.073390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.073522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.073618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.073687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.073822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.073900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.074042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.074165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.074326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.074441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.074569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.074832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.075002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] publish_errors = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.075140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.075258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] publish_errors = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.075377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.075502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.075624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.075624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.075848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.075848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.076067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.076203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.076326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.076326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] standard_threads = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.076539 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.076659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.076826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] standard_threads = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.076826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.077040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.077040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.077246 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.077362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] use_journal = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.077485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.077604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] use_json = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.077717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] use_journal = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.077833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] use_stderr = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.077945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] use_json = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.078061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] use_syslog = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.078185 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] use_stderr = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.078329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.078445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] use_syslog = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.078569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.078688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:03:06.078810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.078921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.079038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.079157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.079269 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.079379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.079498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.079611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.079839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.079965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.080077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.080187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.080310 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.080423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.080534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.080644 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.080644 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.080851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.080973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.081086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.081086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.081301 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.081418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.081529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.081648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.081760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.081872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.081982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.082092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.082211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.082432 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.082549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.082661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.082772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.082883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.082995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.083114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.083227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.083337 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.083448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.083572 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.083684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.083808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.083920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.084037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.084149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.084259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.084372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.084494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.084606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.084716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.084826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.084936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.085054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.085174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.085286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.085402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.085514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.085630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.085750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.085862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.085972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.086089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.086200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.086336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.086463 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.086581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.086699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.086811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.086920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.087037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.087434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.087547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.087659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.087772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.087881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.087992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.088181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.088307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.088418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.088529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.088646 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.088758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.088876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.088988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.089098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.089216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.089328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.089437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.089557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.089669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.089780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.089890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.090000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.090110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.090228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.090390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.090505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.090619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.090735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.090853 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.090974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.091092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.091203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.091315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.091426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.091571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.091681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.091778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.091872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.091972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.092067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.092160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.092160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.092345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.092345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.092517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.092620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.092733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.092733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.092950 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.093061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.093184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.093184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.093411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.093524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.093644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.093644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.093863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.093975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.094086 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.094197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.094326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.094326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.094556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.094668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.094779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.094779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.094987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.095106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.095209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.095319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.095498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.095614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.095726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.095847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.095961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.096073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.096184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.096302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.096423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.096537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.096640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.096750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.096750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.096981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.097156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.097156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.097409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.097521 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.097641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.097755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.097875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.097989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.098101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.098213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.098363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.098479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.098605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.098721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.098833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.098944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.099056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.099167 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.099167 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.099459 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.099571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.099683 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.099804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.099917 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.100037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.100159 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.100283 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.100404 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.100517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.100628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.100741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.100851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.100974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.101087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.101198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.101309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.101420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.101532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.101654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.101768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.101880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.101999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.102112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.102224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.102393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.102510 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.102630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.external = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.102744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.102864 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.102976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.103097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.103211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.103323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.103434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.103545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.password = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.103665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.103805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.token = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.103928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] auth.external = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.104055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.104170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.104282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.104394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.104507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.104633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.104747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.104860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] auth.password = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.104974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.105087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] auth.token = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.105199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.105320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.105433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.105552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.105674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.105788 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.105910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.106033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.106147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.106260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.106398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.106511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.106635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.106759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.106879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.106993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] credential.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.107107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.107219 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.107341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.107464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.107579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.107691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.107803 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.107916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.108029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.108150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.108268 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.108388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.108502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.108614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.108726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.108848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.108968 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.109082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.109196 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.109308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.109420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.109545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.109660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.109772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.109885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.109997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.110109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.110231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.110402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.110535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.110651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.110764 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] federation.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.110877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.111030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.111213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.111357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.111480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.111595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.111707 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.111829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.111944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.112056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.112169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.112283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.112402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.112525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.112640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.112761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.112875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.112988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.113109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.113109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.113401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.113515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.113627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.113740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.113852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.113973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.114087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.114201 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.114338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.114455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.114580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.114696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.114808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.114921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.115034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.115146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.115268 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.115382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.115495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.115608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.115720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.115833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.115953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.116067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.116180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.116293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.116761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.116878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.117001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.117115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.117228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.117340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.117453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.117567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.117688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.117802 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.117914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.118027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.118139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.118251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.118393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.118499 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.118611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.118723 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.118836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.118948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.119070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.119184 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.119296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.119409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.119520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.119633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.119754 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.119867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.119980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.120092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.120204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.120317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.120437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.120552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.120665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.120777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.120889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.121002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.121121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.121235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.121349 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.121461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.121580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.121695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.121816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.121930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.122041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.122153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.122265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.122419 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.122549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.122664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.122778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.122890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.123002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.123116 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.123236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.123351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.123477 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.123581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.123692 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.123806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.123927 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.124041 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.124154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.124266 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.124378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.124490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.124611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.124726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.124839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.124951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.125064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.125176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.125296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.125410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.125522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.125633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.125745 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.125857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.125978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.126093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.126205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.126332 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.126446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.126571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.126784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.126900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.127015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.127127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.127239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.127362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.127476 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.127589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.127701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.127814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.127926 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.128049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.128163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.128276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.128391 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.128503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.128618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.128744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.128860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.128972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.129085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.129197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.129309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.129429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.129543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.129655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.129782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.129911 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.130027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.130150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.130264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.130405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.130519 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.130632 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.130744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.130870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.130985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.131105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.131220 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.131334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.131446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.131568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.131682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.131794 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.131906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.132019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.132132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.132253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.132367 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.132480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.132593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.132705 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.132817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.132938 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.133052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.133165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.133280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.133393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.133505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.133626 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.133740 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.133853 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.133965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.134077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.134189 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.134335 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.134453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.134567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.134680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] resource.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.134792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.134904 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.135026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.135140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.135259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.135375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.135488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] role.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.135601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.135790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] role.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.135906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.136019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.136131 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.136244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.136356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.136478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.136592 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.136705 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.136817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.136929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.137041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] role.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.137162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.137277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] role.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.137391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.137511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.137625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.137738 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.137859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.137973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.138087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.138205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.138373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.138373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.138602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.138718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.138831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.138944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.139057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.139057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.139279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.139392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.139504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.139617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.139729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.139851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.139965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.140077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.140189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.140301 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.140414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.140535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.140651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.140651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.140861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.140974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.141094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.141217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.141331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.141445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.141557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.141670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.141784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.141905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.142019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.142133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.142267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.142397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.142522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.142646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.142762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.142876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.142988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.143101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.143213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.143334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.143448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.143561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] token.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.143673 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.143787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.143908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.144022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.144135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.144248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.144360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.144473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.144594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.144708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.144822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.144941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.145055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.145168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.145289 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] token.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.145403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.145515 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.145628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.145741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.145854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.145974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.146088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.146201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.146367 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.146483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.146596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.146725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.146841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.146955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.147067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.147180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.147292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.147414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.147529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.147641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.147753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.connection = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.147874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.147997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.148111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.148223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.148348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.148462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.148575 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.148687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.148800 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.148912 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.149088 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.149202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.149315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.149427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.149539 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.connection = **** {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.149661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.149818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.149944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.149944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.150177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.150177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.150407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.150407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.150630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.150746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.150858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.150970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.151084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.151196 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.151317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.151431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.151544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.151664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.151779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.151898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.152020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.152135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 03:03:06.152249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.152249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.152249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.152249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.152249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.152249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.152249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.152249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:03:06.152249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 03:03:06.180316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.180541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.180760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.181159 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.181398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.181626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.189469 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.190303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.217224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.217445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.217920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.218148 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.363558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.363764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.412761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.412997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.413557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.413785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.476089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.476286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.476470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.476597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.476699 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.476779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.476875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.476964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.477122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.477262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.477342 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.477540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.502351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.502506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.502605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.502722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.502810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.502969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.503093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.503182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.503259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.503369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.503458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.503603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.503727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.503818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.514678 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.514804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.527327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.527552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.527688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.527769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.527964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.528086 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.528164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.528245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.528321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.528385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.528545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.528669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.528757 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.528930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 03:03:06.546049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.546263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 03:03:06.546419 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.546620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.546765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 03:03:06.546845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 03:03:06.546929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.547085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.547178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 03:03:06.547329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.547468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.547555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.547630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.547814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.547939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.548073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.558887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.559165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.559288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.559411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.559505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.559709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.559834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.560016 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.568130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.568359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.571422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.571637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.571763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.571895 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.571979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.572167 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.572292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.572427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.572508 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.572698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.572836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.572972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.573053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.573199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.573325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.573460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.573553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.573708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.573832 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.573940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.574027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.574226 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.600732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.600860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.602333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.602457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.602605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.602691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.607855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.607981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.608243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.608370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.608524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.608608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.615894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.616013 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.616151 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.616248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.620919 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.621047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.621185 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.621270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.621472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.621599 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.621737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.621854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.621970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.622048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.622247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.622443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.622529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.622594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.622782 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.622927 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.641497 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.641621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.641750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.641835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.646440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.646650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.650085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.650250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.650496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.650641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.655493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.655621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.659158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.659292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.663724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.663870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.664014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.664101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.664215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.664297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.664373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.664518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.664602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.664721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.664801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.664874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.683343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.683472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.683621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.683824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.683966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.684103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.684178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.684297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.692048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.692424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.693727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.693989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.694127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.694351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.697249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.697535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.697659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.697798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.697880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.698107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.698248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.698428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.698514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.698786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.711641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.711912 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.712183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.712322 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.712462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.712584 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.712711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.713009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.714000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.714329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.714616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.714763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.714901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.715201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.732297 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.732962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.735540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.736271 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.738989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.739620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.740720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.741338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.742720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.742993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.743276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.743402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.743619 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.743912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.750704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.751205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.752556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.752852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.755786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.756072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.756197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.756338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.756418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.756720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.756866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.757007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.765744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.766027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.766155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.766344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.766430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.766593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.774177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.774474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.774618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 03:03:06.774758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.774841 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.774999 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.775125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.775262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.775358 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.775612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.775741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.775877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.775976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.776096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.776265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.776360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.776495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.776625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.776785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.776914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.777074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.777203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.777300 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.777380 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.777583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.777712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.777795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.778090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 03:03:06.815054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f4853049c0 pid: 80341 (default app) Jun 28 03:03:06.815565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f4853049c0 pid: 80342 (default app) Jun 28 03:03:06.819035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7fbe-c39c-4333-bc64-172af1844650 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:06.819333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7fbe-c39c-4333-bc64-172af1844650 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:06.819611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7fbe-c39c-4333-bc64-172af1844650 None None] PATH_INFO: `/v3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:06.823840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Tue Jun 28 03:03:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:14.667676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373b6f-f01d-4969-8d62-d0900da05c9c None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:14.668289 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373b6f-f01d-4969-8d62-d0900da05c9c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:14.668289 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373b6f-f01d-4969-8d62-d0900da05c9c None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:14.674835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:14.683614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b831bc-3f07-4d2a-a95c-7aa770178f08 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:14.684085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b831bc-3f07-4d2a-a95c-7aa770178f08 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:14.684182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b831bc-3f07-4d2a-a95c-7aa770178f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:14.754216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: INFO dbcounter [None req-d1b831bc-3f07-4d2a-a95c-7aa770178f08 None None] Registered counter for database keystone Jun 28 03:03:14.779558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG oslo_db.sqlalchemy.engines [None req-d1b831bc-3f07-4d2a-a95c-7aa770178f08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:03:14.791308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writer thread running {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:03:14.973662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG passlib.handlers.bcrypt [None req-d1b831bc-3f07-4d2a-a95c-7aa770178f08 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80341) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 28 03:03:14.973970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG passlib.handlers.bcrypt [None req-d1b831bc-3f07-4d2a-a95c-7aa770178f08 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80341) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 28 03:03:15.029724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d1b831bc-3f07-4d2a-a95c-7aa770178f08 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:15.031372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d1b831bc-3f07-4d2a-a95c-7aa770178f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:15.172767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 28 03:03:15.350680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373b6f-f01d-4969-8d62-d0900da05c9c None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:15.431214 dv-cinder-846842-5-smb devstack@keystone.service[80342]: INFO dbcounter [None req-c4373b6f-f01d-4969-8d62-d0900da05c9c None None] Registered counter for database keystone Jun 28 03:03:15.453287 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG oslo_db.sqlalchemy.engines [None req-c4373b6f-f01d-4969-8d62-d0900da05c9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:03:15.462967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writer thread running {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:03:15.592140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373b6f-f01d-4969-8d62-d0900da05c9c None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:15.598000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b8bf5-9443-4319-875d-8371be98542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:15.598699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b8bf5-9443-4319-875d-8371be98542f admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:15.598977 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b8bf5-9443-4319-875d-8371be98542f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:15.599520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b8bf5-9443-4319-875d-8371be98542f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:15.608708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b8bf5-9443-4319-875d-8371be98542f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:15.660283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bf2b8bf5-9443-4319-875d-8371be98542f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 28 03:03:15.660622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b8bf5-9443-4319-875d-8371be98542f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:15.672312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Tue Jun 28 03:03:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:03:15.679707 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b831bc-3f07-4d2a-a95c-7aa770178f08 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:15.695788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b831bc-3f07-4d2a-a95c-7aa770178f08 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:15.701395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8b53e-aa3c-41a6-a017-3dcbc7d0f3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:15.702592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b53e-aa3c-41a6-a017-3dcbc7d0f3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:15.702873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b53e-aa3c-41a6-a017-3dcbc7d0f3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:15.703148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b53e-aa3c-41a6-a017-3dcbc7d0f3e8 admin admin] PATH_INFO: `/v3/projects/3e3a42e79f984a37804898fa1c77f82d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:15.707990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8b53e-aa3c-41a6-a017-3dcbc7d0f3e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e3a42e79f984a37804898fa1c77f82d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:15.760374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: WARNING keystone.common.rbac_enforcer.enforcer [None req-85b8b53e-aa3c-41a6-a017-3dcbc7d0f3e8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 28 03:03:15.760715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8b53e-aa3c-41a6-a017-3dcbc7d0f3e8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:15.765474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Tue Jun 28 03:03:15 2022] GET /identity/v3/projects/3e3a42e79f984a37804898fa1c77f82d => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:17.772181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc3c2-7b5f-41ca-bdec-3db85c32ffcb None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:17.773047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc3c2-7b5f-41ca-bdec-3db85c32ffcb None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:17.773047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc3c2-7b5f-41ca-bdec-3db85c32ffcb None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:17.779815 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:17.789374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f08a9c-ca69-4bcc-8bc8-a076708eb9cd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:17.789792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f08a9c-ca69-4bcc-8bc8-a076708eb9cd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:17.789973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f08a9c-ca69-4bcc-8bc8-a076708eb9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:17.814824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-58f08a9c-ca69-4bcc-8bc8-a076708eb9cd None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:17.816194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-58f08a9c-ca69-4bcc-8bc8-a076708eb9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:17.826523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 28 03:03:17.849274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccc3c2-7b5f-41ca-bdec-3db85c32ffcb None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:17.868626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccc3c2-7b5f-41ca-bdec-3db85c32ffcb None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:17.877594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82265b6-8602-403c-a42a-6c5f83182990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:17.878746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82265b6-8602-403c-a42a-6c5f83182990 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:17.879156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82265b6-8602-403c-a42a-6c5f83182990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:17.879564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82265b6-8602-403c-a42a-6c5f83182990 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:17.893392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82265b6-8602-403c-a42a-6c5f83182990 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:17.895229 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82265b6-8602-403c-a42a-6c5f83182990 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:17.904571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Tue Jun 28 03:03:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:03:17.913422 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f08a9c-ca69-4bcc-8bc8-a076708eb9cd None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:17.922997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f08a9c-ca69-4bcc-8bc8-a076708eb9cd None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:17.929344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73467f2e-4ae8-447f-9727-bb1a0ae3bffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:17.930230 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73467f2e-4ae8-447f-9727-bb1a0ae3bffe admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:17.930552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73467f2e-4ae8-447f-9727-bb1a0ae3bffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:17.930823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73467f2e-4ae8-447f-9727-bb1a0ae3bffe admin admin] PATH_INFO: `/v3/users/bb2a4b410c314669afc8739724443fa0` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:17.932475 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73467f2e-4ae8-447f-9727-bb1a0ae3bffe admin admin] RBAC: Authorizing `identity:get_user(user_id=bb2a4b410c314669afc8739724443fa0)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:17.934331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73467f2e-4ae8-447f-9727-bb1a0ae3bffe admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:17.935951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Tue Jun 28 03:03:17 2022] GET /identity/v3/users/bb2a4b410c314669afc8739724443fa0 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:20.006310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec6dbc-2d5a-4aeb-b9c1-873bf21d96ee None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.006862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec6dbc-2d5a-4aeb-b9c1-873bf21d96ee None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.006862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec6dbc-2d5a-4aeb-b9c1-873bf21d96ee None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.008260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:20.013719 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291e6a-843d-4062-b1a4-385ddb9a9c00 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.014164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291e6a-843d-4062-b1a4-385ddb9a9c00 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.014253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291e6a-843d-4062-b1a4-385ddb9a9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.027864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022b1c7-2b2e-4636-b327-c1d42956b61c None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.028146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022b1c7-2b2e-4636-b327-c1d42956b61c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.028417 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022b1c7-2b2e-4636-b327-c1d42956b61c None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.029750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:03:20.031529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a7291e6a-843d-4062-b1a4-385ddb9a9c00 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:20.032728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a7291e6a-843d-4062-b1a4-385ddb9a9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:20.034767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034aea5-1663-41c4-a2c7-cf6a91dc3d0e None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.035044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034aea5-1663-41c4-a2c7-cf6a91dc3d0e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.035311 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034aea5-1663-41c4-a2c7-cf6a91dc3d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.075484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG passlib.handlers.bcrypt [None req-8034aea5-1663-41c4-a2c7-cf6a91dc3d0e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80342) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 28 03:03:20.075918 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG passlib.handlers.bcrypt [None req-8034aea5-1663-41c4-a2c7-cf6a91dc3d0e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80342) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 28 03:03:20.121384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8034aea5-1663-41c4-a2c7-cf6a91dc3d0e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:20.122106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:20.123009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8034aea5-1663-41c4-a2c7-cf6a91dc3d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:20.145534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7291e6a-843d-4062-b1a4-385ddb9a9c00 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:20.169967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:20.224097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:20.246495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034aea5-1663-41c4-a2c7-cf6a91dc3d0e None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:20.250728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7291e6a-843d-4062-b1a4-385ddb9a9c00 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:20.284556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874623c-f677-4903-9632-c7cd2ec159ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:20.285295 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874623c-f677-4903-9632-c7cd2ec159ee None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.285578 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874623c-f677-4903-9632-c7cd2ec159ee None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.285854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874623c-f677-4903-9632-c7cd2ec159ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.296819 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874623c-f677-4903-9632-c7cd2ec159ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-7874623c-f677-4903-9632-c7cd2ec159ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:20.308247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:20.309159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:20.309997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:03:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:03:20.315257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874623c-f677-4903-9632-c7cd2ec159ee None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:20.349717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034aea5-1663-41c4-a2c7-cf6a91dc3d0e None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:20.353227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:20.391620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c623776-ed78-4a02-85fd-4b11adc5bdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:20.392676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623776-ed78-4a02-85fd-4b11adc5bdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.392997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623776-ed78-4a02-85fd-4b11adc5bdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.393274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623776-ed78-4a02-85fd-4b11adc5bdb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.411823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:20.433222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874623c-f677-4903-9632-c7cd2ec159ee None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:20.466015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c623776-ed78-4a02-85fd-4b11adc5bdb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:20.467602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c623776-ed78-4a02-85fd-4b11adc5bdb6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:20.470985 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57ed95-2858-4709-983a-aadf2e7cb54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:20.471917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57ed95-2858-4709-983a-aadf2e7cb54c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.472337 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57ed95-2858-4709-983a-aadf2e7cb54c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.472623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57ed95-2858-4709-983a-aadf2e7cb54c None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.473396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57ed95-2858-4709-983a-aadf2e7cb54c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:20.473706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57ed95-2858-4709-983a-aadf2e7cb54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:20.475164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57ed95-2858-4709-983a-aadf2e7cb54c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:20.487612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:20.493781 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57ed95-2858-4709-983a-aadf2e7cb54c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:20.576211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 03:03:20.584160 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c623776-ed78-4a02-85fd-4b11adc5bdb6 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:20.587093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:20.634103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57ed95-2858-4709-983a-aadf2e7cb54c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:20.671163 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556691f-08f1-4213-847e-722b99fa38d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:20.672052 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556691f-08f1-4213-847e-722b99fa38d5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.672338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556691f-08f1-4213-847e-722b99fa38d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.672614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556691f-08f1-4213-847e-722b99fa38d5 None admin] PATH_INFO: `/v3/users/bb2a4b410c314669afc8739724443fa0` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.673884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556691f-08f1-4213-847e-722b99fa38d5 None admin] RBAC: Authorizing `identity:get_user(user_id=bb2a4b410c314669afc8739724443fa0)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:20.675423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556691f-08f1-4213-847e-722b99fa38d5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:20.677128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:20 2022] GET /identity/v3/users/bb2a4b410c314669afc8739724443fa0 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:20.682465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556691f-08f1-4213-847e-722b99fa38d5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:20.697945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:20.702243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c623776-ed78-4a02-85fd-4b11adc5bdb6 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:20.736048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523389aa-e263-45b1-86c8-79c12aa9ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:20.737418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523389aa-e263-45b1-86c8-79c12aa9ecab None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.737698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523389aa-e263-45b1-86c8-79c12aa9ecab None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.737972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523389aa-e263-45b1-86c8-79c12aa9ecab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.758126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523389aa-e263-45b1-86c8-79c12aa9ecab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:20.759628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523389aa-e263-45b1-86c8-79c12aa9ecab None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-523389aa-e263-45b1-86c8-79c12aa9ecab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:03:20.780357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:20.781227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:20.782026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:03:20.782026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:03:20.782026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:03:20.782026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:20.782026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:03:20.783135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556691f-08f1-4213-847e-722b99fa38d5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:20.788850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523389aa-e263-45b1-86c8-79c12aa9ecab None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:20.817612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5524f1-2351-4910-b0e0-bb3dcc6965c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:20.818453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5524f1-2351-4910-b0e0-bb3dcc6965c8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.818737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5524f1-2351-4910-b0e0-bb3dcc6965c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.819022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5524f1-2351-4910-b0e0-bb3dcc6965c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.820205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5524f1-2351-4910-b0e0-bb3dcc6965c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:20.821670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5524f1-2351-4910-b0e0-bb3dcc6965c8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:20.823519 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:20.829014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5524f1-2351-4910-b0e0-bb3dcc6965c8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:20.844951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:20.892236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523389aa-e263-45b1-86c8-79c12aa9ecab None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:20.915878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:20.933821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f525e-dce5-438f-8fec-c828b228b07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:20.934545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f525e-dce5-438f-8fec-c828b228b07d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.934824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f525e-dce5-438f-8fec-c828b228b07d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.935095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f525e-dce5-438f-8fec-c828b228b07d None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.935836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f525e-dce5-438f-8fec-c828b228b07d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:20.936142 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f525e-dce5-438f-8fec-c828b228b07d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:20.937176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5524f1-2351-4910-b0e0-bb3dcc6965c8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:20.937545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f525e-dce5-438f-8fec-c828b228b07d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:20.955305 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:20.971923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261afe7-5a9e-4ed5-842e-8efb43c09e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:20.972234 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261afe7-5a9e-4ed5-842e-8efb43c09e65 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:20.972514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261afe7-5a9e-4ed5-842e-8efb43c09e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:20.972785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261afe7-5a9e-4ed5-842e-8efb43c09e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:20.973647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261afe7-5a9e-4ed5-842e-8efb43c09e65 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.domain.id=default, user.id=bb2a4b410c314669afc8739724443fa0) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:20.973945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261afe7-5a9e-4ed5-842e-8efb43c09e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:20.975459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261afe7-5a9e-4ed5-842e-8efb43c09e65 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:20.983529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1322 bytes} [Tue Jun 28 03:03:20 2022] GET /identity/v3/role_assignments?user.id=bb2a4b410c314669afc8739724443fa0&scope.domain.id=default&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:23.523155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d45e9-2f4d-4470-9d30-dc034b27372f None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:23.523678 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d45e9-2f4d-4470-9d30-dc034b27372f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:23.523678 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d45e9-2f4d-4470-9d30-dc034b27372f None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:23.525108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:23.530512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d069d0-9939-4296-9c3c-28b8bc537f6d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:23.531323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d069d0-9939-4296-9c3c-28b8bc537f6d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:23.531798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d069d0-9939-4296-9c3c-28b8bc537f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:23.550164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-28d069d0-9939-4296-9c3c-28b8bc537f6d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:23.551674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-28d069d0-9939-4296-9c3c-28b8bc537f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:23.575560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2902e-65c3-49ae-84d5-a5b575db2502 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:23.576178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2902e-65c3-49ae-84d5-a5b575db2502 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:23.576653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2902e-65c3-49ae-84d5-a5b575db2502 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:23.578216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 12/23] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:03:23.583714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a19e-c6f8-4f3d-8057-a7c7fd418a17 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:23.584154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a19e-c6f8-4f3d-8057-a7c7fd418a17 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:23.584556 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758a19e-c6f8-4f3d-8057-a7c7fd418a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:23.607528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5758a19e-c6f8-4f3d-8057-a7c7fd418a17 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:23.609671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5758a19e-c6f8-4f3d-8057-a7c7fd418a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:23.672702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:23.739863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:23.746642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d069d0-9939-4296-9c3c-28b8bc537f6d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:23.757321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1f7a4-8b29-4043-a3ed-98dd07013604 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:23.759429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1f7a4-8b29-4043-a3ed-98dd07013604 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:23.760061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1f7a4-8b29-4043-a3ed-98dd07013604 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:23.762649 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 14/26] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:23.767720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d8f9-fd60-42e1-8093-d217ff5b878e None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:23.768774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d8f9-fd60-42e1-8093-d217ff5b878e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:23.769188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d8f9-fd60-42e1-8093-d217ff5b878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:23.796251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-1e12d8f9-fd60-42e1-8093-d217ff5b878e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:23.797730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1e12d8f9-fd60-42e1-8093-d217ff5b878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:23.846720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:23.886319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 15/27] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:23.886943 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:23.891056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12d8f9-fd60-42e1-8093-d217ff5b878e None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:23.897768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d069d0-9939-4296-9c3c-28b8bc537f6d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:23.961085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce23f7-042e-42da-8c26-4cf650357438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:23.967074 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce23f7-042e-42da-8c26-4cf650357438 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:23.967562 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce23f7-042e-42da-8c26-4cf650357438 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:23.968022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce23f7-042e-42da-8c26-4cf650357438 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:23.969014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce23f7-042e-42da-8c26-4cf650357438 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:23.970663 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce23f7-042e-42da-8c26-4cf650357438 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:24.067028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12d8f9-fd60-42e1-8093-d217ff5b878e None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:24.107333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e245e-b980-4599-931b-a1c089bb88d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:24.108163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e245e-b980-4599-931b-a1c089bb88d2 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:24.108446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e245e-b980-4599-931b-a1c089bb88d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:24.108721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e245e-b980-4599-931b-a1c089bb88d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:24.121127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e245e-b980-4599-931b-a1c089bb88d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-cc6e245e-b980-4599-931b-a1c089bb88d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:24.130889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:24.131753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:24.132504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:24.133061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 16/28] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:03:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:24.133642 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e245e-b980-4599-931b-a1c089bb88d2 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:24.140568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 13/29] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Jun 28 03:03:23 2022] POST /identity/v3/roles => generated 219 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:24.142409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50b11f-b08c-43b9-9388-20d7c8ddf07a None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:24.142964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50b11f-b08c-43b9-9388-20d7c8ddf07a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:24.144728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50b11f-b08c-43b9-9388-20d7c8ddf07a None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:24.146863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 14/30] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:24.147909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50b11f-b08c-43b9-9388-20d7c8ddf07a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:24.180111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:24.262982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e245e-b980-4599-931b-a1c089bb88d2 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:24.293599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50b11f-b08c-43b9-9388-20d7c8ddf07a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:24.308519 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a41520-069a-4396-9968-c62b20a81dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:24.309483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41520-069a-4396-9968-c62b20a81dea None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:24.309706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41520-069a-4396-9968-c62b20a81dea None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:24.310082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41520-069a-4396-9968-c62b20a81dea None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:24.310999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a41520-069a-4396-9968-c62b20a81dea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:24.312588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a41520-069a-4396-9968-c62b20a81dea None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:24.338010 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12535f-e877-4e08-98f9-f65bf7eead5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:24.339170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12535f-e877-4e08-98f9-f65bf7eead5d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:24.339657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12535f-e877-4e08-98f9-f65bf7eead5d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:24.339931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12535f-e877-4e08-98f9-f65bf7eead5d None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:24.340727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12535f-e877-4e08-98f9-f65bf7eead5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:24.341043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12535f-e877-4e08-98f9-f65bf7eead5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:24.345024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12535f-e877-4e08-98f9-f65bf7eead5d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:24.345024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:24.354236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 15/31] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:24.355599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209cc12-daa3-4bee-aa16-b736de192ae0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:24.355957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209cc12-daa3-4bee-aa16-b736de192ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:24.356240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209cc12-daa3-4bee-aa16-b736de192ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:24.374786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6209cc12-daa3-4bee-aa16-b736de192ae0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:24.376328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6209cc12-daa3-4bee-aa16-b736de192ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:24.447065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 17/32] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Jun 28 03:03:24 2022] POST /identity/v3/roles => generated 225 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:24.448718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe227-7f8c-4369-a1e0-f213406eb73e None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:24.449024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe227-7f8c-4369-a1e0-f213406eb73e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:24.449308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fe227-7f8c-4369-a1e0-f213406eb73e None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:24.449857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 16/33] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:24.450620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209cc12-daa3-4bee-aa16-b736de192ae0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:24.450737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 18/34] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:24.456431 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388394b-e3c5-427b-ac1f-1ed026b7216c None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:24.456844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388394b-e3c5-427b-ac1f-1ed026b7216c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:24.457230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388394b-e3c5-427b-ac1f-1ed026b7216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:24.475693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5388394b-e3c5-427b-ac1f-1ed026b7216c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:24.477473 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5388394b-e3c5-427b-ac1f-1ed026b7216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:24.559262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 19/35] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:24.560051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388394b-e3c5-427b-ac1f-1ed026b7216c None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:24.585631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209cc12-daa3-4bee-aa16-b736de192ae0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:24.610917 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:24.622055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:24.636442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582ab4f-fcda-4284-b31e-455da067f2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:24.637405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ab4f-fcda-4284-b31e-455da067f2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:24.637692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ab4f-fcda-4284-b31e-455da067f2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:24.637969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ab4f-fcda-4284-b31e-455da067f2e9 None admin] PATH_INFO: `/v3/users/bb2a4b410c314669afc8739724443fa0` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:24.639420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582ab4f-fcda-4284-b31e-455da067f2e9 None admin] RBAC: Authorizing `identity:get_user(user_id=bb2a4b410c314669afc8739724443fa0)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:24.641039 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582ab4f-fcda-4284-b31e-455da067f2e9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:24.643302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 17/36] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:24 2022] GET /identity/v3/users/bb2a4b410c314669afc8739724443fa0 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:24.644032 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582ab4f-fcda-4284-b31e-455da067f2e9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:24.710929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388394b-e3c5-427b-ac1f-1ed026b7216c None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:24.746528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332bfb3-f0c4-4816-b8be-47607d491463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:24.747350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332bfb3-f0c4-4816-b8be-47607d491463 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:24.747626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332bfb3-f0c4-4816-b8be-47607d491463 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:24.747907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332bfb3-f0c4-4816-b8be-47607d491463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:24.759352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332bfb3-f0c4-4816-b8be-47607d491463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:24.760735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582ab4f-fcda-4284-b31e-455da067f2e9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:24.760971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332bfb3-f0c4-4816-b8be-47607d491463 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-0332bfb3-f0c4-4816-b8be-47607d491463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:03:24.779543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:24.780393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:24.781201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:03:24.781201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:03:24.781201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:03:24.781201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:24.781201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 20/37] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:24.781916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332bfb3-f0c4-4816-b8be-47607d491463 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:24.801761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87ed9e-436e-4448-99ac-72565f711b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:24.802486 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87ed9e-436e-4448-99ac-72565f711b93 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:24.802771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87ed9e-436e-4448-99ac-72565f711b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:24.803047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87ed9e-436e-4448-99ac-72565f711b93 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:24.803803 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87ed9e-436e-4448-99ac-72565f711b93 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:24.805212 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87ed9e-436e-4448-99ac-72565f711b93 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:24.819916 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 18/38] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Jun 28 03:03:24 2022] POST /identity/v3/roles => generated 223 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:24.820666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87ed9e-436e-4448-99ac-72565f711b93 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:24.897318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:24.920667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:24.940302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332bfb3-f0c4-4816-b8be-47607d491463 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:24.960787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87ed9e-436e-4448-99ac-72565f711b93 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:24.982245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793084c-33e3-4393-a942-7cdcf3dceee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:24.983502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793084c-33e3-4393-a942-7cdcf3dceee0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:24.983979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793084c-33e3-4393-a942-7cdcf3dceee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:24.984482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793084c-33e3-4393-a942-7cdcf3dceee0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:24.986219 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793084c-33e3-4393-a942-7cdcf3dceee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:24.988710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793084c-33e3-4393-a942-7cdcf3dceee0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:24.995778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 21/39] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:24.997514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793084c-33e3-4393-a942-7cdcf3dceee0 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:25.007990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5117f-2233-4289-8863-91200e799f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:25.009189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5117f-2233-4289-8863-91200e799f78 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:25.009478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5117f-2233-4289-8863-91200e799f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:25.009803 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5117f-2233-4289-8863-91200e799f78 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:25.011703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5117f-2233-4289-8863-91200e799f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:25.011703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5117f-2233-4289-8863-91200e799f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:25.012463 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5117f-2233-4289-8863-91200e799f78 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:25.033022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 19/40] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:25.039862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5117f-2233-4289-8863-91200e799f78 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:25.125108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793084c-33e3-4393-a942-7cdcf3dceee0 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:25.159355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ddc9-3ced-4645-a858-ee160ddc1181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:25.160272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ddc9-3ced-4645-a858-ee160ddc1181 None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:25.160566 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ddc9-3ced-4645-a858-ee160ddc1181 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:25.160848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ddc9-3ced-4645-a858-ee160ddc1181 None admin] PATH_INFO: `/v3/domains/default/users/bb2a4b410c314669afc8739724443fa0/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:25.163284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ddc9-3ced-4645-a858-ee160ddc1181 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bb2a4b410c314669afc8739724443fa0, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:25.164758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ddc9-3ced-4645-a858-ee160ddc1181 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:25.165740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5117f-2233-4289-8863-91200e799f78 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:25.180401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:25.194323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 22/41] 10.222.0.23 () {58 vars in 1361 bytes} [Tue Jun 28 03:03:24 2022] PUT /identity/v3/domains/default/users/bb2a4b410c314669afc8739724443fa0/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:03:25.194323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e0be-6eb9-466a-b0a8-e3f5fc86a68c None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:25.194323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e0be-6eb9-466a-b0a8-e3f5fc86a68c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:25.194323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e0be-6eb9-466a-b0a8-e3f5fc86a68c None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:25.194323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 23/42] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:25.201254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80677c09-878d-4115-a7f3-a01c214d42b0 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:25.201546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80677c09-878d-4115-a7f3-a01c214d42b0 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:25.201828 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80677c09-878d-4115-a7f3-a01c214d42b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:25.202134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6015e93-9633-4f32-9789-b96e13fcd7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:25.202874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015e93-9633-4f32-9789-b96e13fcd7a8 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:25.203161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015e93-9633-4f32-9789-b96e13fcd7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:25.203442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015e93-9633-4f32-9789-b96e13fcd7a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:25.204179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6015e93-9633-4f32-9789-b96e13fcd7a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:25.206155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6015e93-9633-4f32-9789-b96e13fcd7a8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:25.214897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:25.221209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-80677c09-878d-4115-a7f3-a01c214d42b0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:25.223076 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-80677c09-878d-4115-a7f3-a01c214d42b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:25.307599 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 24/43] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:25.332055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80677c09-878d-4115-a7f3-a01c214d42b0 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:25.359292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 20/44] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:03:25 2022] POST /identity/v3/projects => generated 301 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:25.445647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80677c09-878d-4115-a7f3-a01c214d42b0 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:25.483516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe47145-08df-4be0-95e9-e2b6c79a353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:25.484423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe47145-08df-4be0-95e9-e2b6c79a353a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:25.484708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe47145-08df-4be0-95e9-e2b6c79a353a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:25.484989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe47145-08df-4be0-95e9-e2b6c79a353a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:25.486314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe47145-08df-4be0-95e9-e2b6c79a353a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:25.488594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe47145-08df-4be0-95e9-e2b6c79a353a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:25.490508 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 25/45] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:25.496557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6015e93-9633-4f32-9789-b96e13fcd7a8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:25.608261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6015e93-9633-4f32-9789-b96e13fcd7a8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:25.646942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5bafc-a5af-4570-b31e-9e2ad02c0c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:25.647613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5bafc-a5af-4570-b31e-9e2ad02c0c87 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:25.647893 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5bafc-a5af-4570-b31e-9e2ad02c0c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:25.648159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5bafc-a5af-4570-b31e-9e2ad02c0c87 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:25.648894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5bafc-a5af-4570-b31e-9e2ad02c0c87 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:25.650354 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5bafc-a5af-4570-b31e-9e2ad02c0c87 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:25.679790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 21/46] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:03:25 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:27.280720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde927f-b392-4f1b-a022-2784afc83ed4 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:27.281275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde927f-b392-4f1b-a022-2784afc83ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:27.281275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde927f-b392-4f1b-a022-2784afc83ed4 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:27.282821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 26/47] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:27.288374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e7b1c-3801-4ad6-a4d1-734c264f6b71 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:27.288800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e7b1c-3801-4ad6-a4d1-734c264f6b71 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:27.288928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e7b1c-3801-4ad6-a4d1-734c264f6b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:27.307316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4d3e7b1c-3801-4ad6-a4d1-734c264f6b71 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:27.309202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4d3e7b1c-3801-4ad6-a4d1-734c264f6b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:27.327950 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:27.394235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 22/48] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:27.417580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde927f-b392-4f1b-a022-2784afc83ed4 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:27.421810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:27.526059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde927f-b392-4f1b-a022-2784afc83ed4 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:27.560992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10828b86-614c-41d0-a7e9-e86059518d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:27.561731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10828b86-614c-41d0-a7e9-e86059518d60 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:27.562018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10828b86-614c-41d0-a7e9-e86059518d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:27.562328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10828b86-614c-41d0-a7e9-e86059518d60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:27.573414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10828b86-614c-41d0-a7e9-e86059518d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-10828b86-614c-41d0-a7e9-e86059518d60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:27.581262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:27.582154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:27.583040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 27/49] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:03:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:27.588595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e7b1c-3801-4ad6-a4d1-734c264f6b71 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:27.696869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e7b1c-3801-4ad6-a4d1-734c264f6b71 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:27.713518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4cc8e-004f-49e6-b45d-833783f0755d None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:27.714210 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4cc8e-004f-49e6-b45d-833783f0755d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:27.714518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4cc8e-004f-49e6-b45d-833783f0755d None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:27.715930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 28/50] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:03:27.722466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e1fd4-187f-4d39-94a6-3cc7f369da33 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:27.722732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e1fd4-187f-4d39-94a6-3cc7f369da33 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:27.723041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e1fd4-187f-4d39-94a6-3cc7f369da33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:27.733754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd5251-84f1-44f4-b8f2-331b80f310bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:27.734472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5251-84f1-44f4-b8f2-331b80f310bd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:27.734761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5251-84f1-44f4-b8f2-331b80f310bd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:27.735083 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5251-84f1-44f4-b8f2-331b80f310bd None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:27.735998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd5251-84f1-44f4-b8f2-331b80f310bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:27.736311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd5251-84f1-44f4-b8f2-331b80f310bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:27.737902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd5251-84f1-44f4-b8f2-331b80f310bd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:27.740981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-2d3e1fd4-187f-4d39-94a6-3cc7f369da33 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:27.742682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-2d3e1fd4-187f-4d39-94a6-3cc7f369da33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:27.747270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 23/51] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:27.753023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd5251-84f1-44f4-b8f2-331b80f310bd None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:27.765670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:27.804444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:27.813930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 29/52] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:27.836727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e1fd4-187f-4d39-94a6-3cc7f369da33 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:27.854262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd5251-84f1-44f4-b8f2-331b80f310bd None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:27.887605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f9d6e-5bfa-49a9-9bbf-df46618bf326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:27.888497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f9d6e-5bfa-49a9-9bbf-df46618bf326 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:27.888780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f9d6e-5bfa-49a9-9bbf-df46618bf326 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:27.889057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f9d6e-5bfa-49a9-9bbf-df46618bf326 None admin] PATH_INFO: `/v3/users/bb2a4b410c314669afc8739724443fa0` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:27.890311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f9d6e-5bfa-49a9-9bbf-df46618bf326 None admin] RBAC: Authorizing `identity:get_user(user_id=bb2a4b410c314669afc8739724443fa0)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:27.891776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f9d6e-5bfa-49a9-9bbf-df46618bf326 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:27.893515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 24/53] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:27 2022] GET /identity/v3/users/bb2a4b410c314669afc8739724443fa0 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:27.899063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f9d6e-5bfa-49a9-9bbf-df46618bf326 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:27.934586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e1fd4-187f-4d39-94a6-3cc7f369da33 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:27.969635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1556c1-1a07-46b4-b5d8-79c3200eb67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:27.970481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1556c1-1a07-46b4-b5d8-79c3200eb67e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:27.970806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1556c1-1a07-46b4-b5d8-79c3200eb67e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:27.971120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1556c1-1a07-46b4-b5d8-79c3200eb67e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:27.972338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1556c1-1a07-46b4-b5d8-79c3200eb67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:27.973792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1556c1-1a07-46b4-b5d8-79c3200eb67e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:27.975433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 30/54] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:27.976900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:27.981483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1556c1-1a07-46b4-b5d8-79c3200eb67e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:28.000282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f9d6e-5bfa-49a9-9bbf-df46618bf326 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:28.050673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7721b-42eb-477b-9ec8-ebd70f99ff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:28.051523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7721b-42eb-477b-9ec8-ebd70f99ff62 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:28.051807 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7721b-42eb-477b-9ec8-ebd70f99ff62 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:28.052081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7721b-42eb-477b-9ec8-ebd70f99ff62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:28.053457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7721b-42eb-477b-9ec8-ebd70f99ff62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:28.055033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7721b-42eb-477b-9ec8-ebd70f99ff62 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:28.056763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 25/55] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:28.063023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7721b-42eb-477b-9ec8-ebd70f99ff62 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:28.155827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:28.173336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7721b-42eb-477b-9ec8-ebd70f99ff62 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:28.195185 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1556c1-1a07-46b4-b5d8-79c3200eb67e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:28.207505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ee7ff-2876-4b1d-9fcd-d187c20f742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:28.208162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee7ff-2876-4b1d-9fcd-d187c20f742b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:28.208452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee7ff-2876-4b1d-9fcd-d187c20f742b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:28.208735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee7ff-2876-4b1d-9fcd-d187c20f742b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:28.209569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ee7ff-2876-4b1d-9fcd-d187c20f742b None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.domain.id=default, user.id=bb2a4b410c314669afc8739724443fa0) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:28.209878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ee7ff-2876-4b1d-9fcd-d187c20f742b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:28.211360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ee7ff-2876-4b1d-9fcd-d187c20f742b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:28.217102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 26/56] 10.222.0.23 () {56 vars in 1322 bytes} [Tue Jun 28 03:03:28 2022] GET /identity/v3/role_assignments?user.id=bb2a4b410c314669afc8739724443fa0&scope.domain.id=default&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:28.229127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb35c57-628c-4b06-b6d4-31f8e83b74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:28.229823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35c57-628c-4b06-b6d4-31f8e83b74e6 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:28.230096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35c57-628c-4b06-b6d4-31f8e83b74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:28.230401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35c57-628c-4b06-b6d4-31f8e83b74e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:28.231219 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb35c57-628c-4b06-b6d4-31f8e83b74e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:28.232749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb35c57-628c-4b06-b6d4-31f8e83b74e6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:28.262104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 31/57] 10.222.0.23 () {60 vars in 1140 bytes} [Tue Jun 28 03:03:27 2022] POST /identity/v3/projects => generated 298 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:30.292867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbbcd8-b58f-4046-ba4d-d62493143ca2 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:30.293684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbbcd8-b58f-4046-ba4d-d62493143ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:30.293828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbbcd8-b58f-4046-ba4d-d62493143ca2 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:30.296024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 27/58] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:30.301457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89dc97-56f5-4080-9ec1-f143843a8f0f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:30.301868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89dc97-56f5-4080-9ec1-f143843a8f0f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:30.301953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89dc97-56f5-4080-9ec1-f143843a8f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:30.321057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-3b89dc97-56f5-4080-9ec1-f143843a8f0f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:30.322238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3b89dc97-56f5-4080-9ec1-f143843a8f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:30.399562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 32/59] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:30.424632 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbbcd8-b58f-4046-ba4d-d62493143ca2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:30.445590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:30.556561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbbcd8-b58f-4046-ba4d-d62493143ca2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:30.591137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c61a3-e0ab-4b5b-8812-0fc56bb86953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:30.591935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c61a3-e0ab-4b5b-8812-0fc56bb86953 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:30.592213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c61a3-e0ab-4b5b-8812-0fc56bb86953 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:30.592485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c61a3-e0ab-4b5b-8812-0fc56bb86953 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:30.593711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c61a3-e0ab-4b5b-8812-0fc56bb86953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:30.595181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c61a3-e0ab-4b5b-8812-0fc56bb86953 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:30.597093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 28/60] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:30.603285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89dc97-56f5-4080-9ec1-f143843a8f0f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:30.650890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:30.708177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89dc97-56f5-4080-9ec1-f143843a8f0f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:30.747404 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05806a14-aa70-4071-ad51-ea020bb04cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:30.748080 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05806a14-aa70-4071-ad51-ea020bb04cc5 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:30.748366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05806a14-aa70-4071-ad51-ea020bb04cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:30.748634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05806a14-aa70-4071-ad51-ea020bb04cc5 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:30.749345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05806a14-aa70-4071-ad51-ea020bb04cc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:30.750836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05806a14-aa70-4071-ad51-ea020bb04cc5 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:30.776186 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 33/61] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:03:30 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:03:33.846145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ea9a5-1620-4de4-b4e7-ff9ca89f5d49 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:33.847228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ea9a5-1620-4de4-b4e7-ff9ca89f5d49 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:33.847708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ea9a5-1620-4de4-b4e7-ff9ca89f5d49 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:33.849565 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 29/62] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:33.855031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb69813-d985-438e-8fed-9cd274345e1a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:33.855444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb69813-d985-438e-8fed-9cd274345e1a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:33.855606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb69813-d985-438e-8fed-9cd274345e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:33.877005 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-fdb69813-d985-438e-8fed-9cd274345e1a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:33.878456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fdb69813-d985-438e-8fed-9cd274345e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:33.970391 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 34/63] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:34.006269 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ea9a5-1620-4de4-b4e7-ff9ca89f5d49 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:34.022282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55319f06-e0d6-4e87-919d-7c6bd20a26f0 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.022978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55319f06-e0d6-4e87-919d-7c6bd20a26f0 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.023444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55319f06-e0d6-4e87-919d-7c6bd20a26f0 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.025029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 35/64] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:03:34.030208 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ec6f-4c09-4a0c-ac03-6260762c8a47 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.030903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ec6f-4c09-4a0c-ac03-6260762c8a47 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.031455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ec6f-4c09-4a0c-ac03-6260762c8a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.054202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-bd33ec6f-4c09-4a0c-ac03-6260762c8a47 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:34.055738 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bd33ec6f-4c09-4a0c-ac03-6260762c8a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:34.086679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:34.150043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:34.163859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 36/65] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:34.187792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33ec6f-4c09-4a0c-ac03-6260762c8a47 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:34.201458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ea9a5-1620-4de4-b4e7-ff9ca89f5d49 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:34.243905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3c2b-5d33-4a2d-8152-a7d43241c28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:34.245184 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3c2b-5d33-4a2d-8152-a7d43241c28e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.245655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3c2b-5d33-4a2d-8152-a7d43241c28e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.246162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3c2b-5d33-4a2d-8152-a7d43241c28e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.257872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f3c2b-5d33-4a2d-8152-a7d43241c28e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-8c0f3c2b-5d33-4a2d-8152-a7d43241c28e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:34.266250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:34.267117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:34.268600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:34.271207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 30/66] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:34.272809 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e26d6c-5ea5-40eb-9686-3b17dd35b6d1 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.273332 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e26d6c-5ea5-40eb-9686-3b17dd35b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.273790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e26d6c-5ea5-40eb-9686-3b17dd35b6d1 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.275398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 31/67] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:34.277312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e26d6c-5ea5-40eb-9686-3b17dd35b6d1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:34.300819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33ec6f-4c09-4a0c-ac03-6260762c8a47 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:34.338700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0fa25-7f7d-4088-a615-1cf2ae506b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:34.339680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0fa25-7f7d-4088-a615-1cf2ae506b58 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.340052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0fa25-7f7d-4088-a615-1cf2ae506b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.340423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0fa25-7f7d-4088-a615-1cf2ae506b58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.352358 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0fa25-7f7d-4088-a615-1cf2ae506b58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-41b0fa25-7f7d-4088-a615-1cf2ae506b58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:34.360639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:34.361636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:34.362451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 37/68] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:03:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:03:34.368803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6e026-b996-4aef-b1bf-e68e0651af01 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.369152 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6e026-b996-4aef-b1bf-e68e0651af01 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.369498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6e026-b996-4aef-b1bf-e68e0651af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.388157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-55f6e026-b996-4aef-b1bf-e68e0651af01 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:34.389559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-55f6e026-b996-4aef-b1bf-e68e0651af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:34.403739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e26d6c-5ea5-40eb-9686-3b17dd35b6d1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:34.405457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:34.452381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77fadd-f402-4b3a-81d2-df20594846c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:34.453609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77fadd-f402-4b3a-81d2-df20594846c9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.454479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77fadd-f402-4b3a-81d2-df20594846c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.454929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77fadd-f402-4b3a-81d2-df20594846c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.456205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77fadd-f402-4b3a-81d2-df20594846c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:34.456724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77fadd-f402-4b3a-81d2-df20594846c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:34.458852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77fadd-f402-4b3a-81d2-df20594846c9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:34.466474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:34.471228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 32/69] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:34.472293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77fadd-f402-4b3a-81d2-df20594846c9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:34.473483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 38/70] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:34.474942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695057f7-924a-45c0-8af4-16f2381bd3ad None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.475344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695057f7-924a-45c0-8af4-16f2381bd3ad None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.482416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695057f7-924a-45c0-8af4-16f2381bd3ad None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.482416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 39/71] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:34.482416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695057f7-924a-45c0-8af4-16f2381bd3ad None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:34.589148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77fadd-f402-4b3a-81d2-df20594846c9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:34.590714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695057f7-924a-45c0-8af4-16f2381bd3ad None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:34.623811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b288-15d9-411d-a3d2-1aee13f67ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:34.624490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b288-15d9-411d-a3d2-1aee13f67ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.624773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b288-15d9-411d-a3d2-1aee13f67ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.625043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b288-15d9-411d-a3d2-1aee13f67ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.625786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b288-15d9-411d-a3d2-1aee13f67ba3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:34.626089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b288-15d9-411d-a3d2-1aee13f67ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:34.626723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc43cfc-c1d9-4283-bf21-9b83c4c95703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:34.627577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b288-15d9-411d-a3d2-1aee13f67ba3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:34.627941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc43cfc-c1d9-4283-bf21-9b83c4c95703 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.628227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc43cfc-c1d9-4283-bf21-9b83c4c95703 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.628502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc43cfc-c1d9-4283-bf21-9b83c4c95703 None admin] PATH_INFO: `/v3/users/33ca46aa10824dbdb4be243951ab25d7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.640258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 33/72] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:34.640258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9e921-c3a2-48f8-ad1b-75b8b121423e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.640258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9e921-c3a2-48f8-ad1b-75b8b121423e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.640258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9e921-c3a2-48f8-ad1b-75b8b121423e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.650567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc43cfc-c1d9-4283-bf21-9b83c4c95703 None admin] RBAC: Authorizing `identity:get_user(user_id=33ca46aa10824dbdb4be243951ab25d7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:34.652076 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc43cfc-c1d9-4283-bf21-9b83c4c95703 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:34.654057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a0b9e921-c3a2-48f8-ad1b-75b8b121423e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:34.654168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 40/73] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:34 2022] GET /identity/v3/users/33ca46aa10824dbdb4be243951ab25d7 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:34.654644 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc43cfc-c1d9-4283-bf21-9b83c4c95703 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:34.659925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a0b9e921-c3a2-48f8-ad1b-75b8b121423e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:34.665757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:34.719245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:34.729820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 34/74] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:34.730674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9e921-c3a2-48f8-ad1b-75b8b121423e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:34.762163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc43cfc-c1d9-4283-bf21-9b83c4c95703 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:34.795345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548009-d966-4509-b9cb-b97ca66a76be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:34.796377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548009-d966-4509-b9cb-b97ca66a76be None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.796662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548009-d966-4509-b9cb-b97ca66a76be None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.796940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548009-d966-4509-b9cb-b97ca66a76be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.808078 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1548009-d966-4509-b9cb-b97ca66a76be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-f1548009-d966-4509-b9cb-b97ca66a76be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:34.816411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:34.817281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:34.818037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 41/75] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:03:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:34.818699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548009-d966-4509-b9cb-b97ca66a76be None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:34.831488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9e921-c3a2-48f8-ad1b-75b8b121423e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:34.865636 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c531e3d-a164-4de6-b906-50f627c8205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:34.866915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c531e3d-a164-4de6-b906-50f627c8205c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.867193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c531e3d-a164-4de6-b906-50f627c8205c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.867465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c531e3d-a164-4de6-b906-50f627c8205c None admin] PATH_INFO: `/v3/users/bb2a4b410c314669afc8739724443fa0` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.868683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c531e3d-a164-4de6-b906-50f627c8205c None admin] RBAC: Authorizing `identity:get_user(user_id=bb2a4b410c314669afc8739724443fa0)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:34.870154 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c531e3d-a164-4de6-b906-50f627c8205c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:34.871818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 35/76] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:34 2022] GET /identity/v3/users/bb2a4b410c314669afc8739724443fa0 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:34.873040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd7ade-f70b-4f89-a873-d4b905309ccf None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.873321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd7ade-f70b-4f89-a873-d4b905309ccf None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.873592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd7ade-f70b-4f89-a873-d4b905309ccf None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.875017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 36/77] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:34.875606 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd7ade-f70b-4f89-a873-d4b905309ccf None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:34.889079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:34.921590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548009-d966-4509-b9cb-b97ca66a76be None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:34.935768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:34.954968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd08b39-ba7d-48e0-95a7-766e726b3f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:34.955680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd08b39-ba7d-48e0-95a7-766e726b3f25 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:34.955958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd08b39-ba7d-48e0-95a7-766e726b3f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:34.956242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd08b39-ba7d-48e0-95a7-766e726b3f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:34.977319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd7ade-f70b-4f89-a873-d4b905309ccf None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:35.010876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae2ee4-b2bb-4811-a6fc-fffd3a863058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:35.011679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae2ee4-b2bb-4811-a6fc-fffd3a863058 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:35.011964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae2ee4-b2bb-4811-a6fc-fffd3a863058 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:35.012238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae2ee4-b2bb-4811-a6fc-fffd3a863058 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:35.022022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd08b39-ba7d-48e0-95a7-766e726b3f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:35.022646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae2ee4-b2bb-4811-a6fc-fffd3a863058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:35.023559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd08b39-ba7d-48e0-95a7-766e726b3f25 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-e9ae2ee4-b2bb-4811-a6fc-fffd3a863058 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:35.030414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:35.031280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 37/78] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:35.033050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae2ee4-b2bb-4811-a6fc-fffd3a863058 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:35.089318 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:35.124552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 42/79] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:35.125396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd08b39-ba7d-48e0-95a7-766e726b3f25 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:35.136506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae2ee4-b2bb-4811-a6fc-fffd3a863058 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:35.157939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:35.173541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f1297-1c81-4603-b365-0ed95c4d2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:35.174013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f1297-1c81-4603-b365-0ed95c4d2e37 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:35.174749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f1297-1c81-4603-b365-0ed95c4d2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:35.174749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f1297-1c81-4603-b365-0ed95c4d2e37 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:35.175340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f1297-1c81-4603-b365-0ed95c4d2e37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:35.175644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f1297-1c81-4603-b365-0ed95c4d2e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:35.177088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f1297-1c81-4603-b365-0ed95c4d2e37 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:35.185111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 38/80] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:03:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:35.186431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c275-d661-4083-8537-5ab6fbd5f94c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:35.186716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c275-d661-4083-8537-5ab6fbd5f94c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:35.186987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c275-d661-4083-8537-5ab6fbd5f94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:35.204317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a034c275-d661-4083-8537-5ab6fbd5f94c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:35.205755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a034c275-d661-4083-8537-5ab6fbd5f94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:35.245410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd08b39-ba7d-48e0-95a7-766e726b3f25 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:35.271078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 39/81] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:35.272087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c275-d661-4083-8537-5ab6fbd5f94c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:35.279280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23a2d0-c48c-450d-a107-e3c9aff3a545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:35.279940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23a2d0-c48c-450d-a107-e3c9aff3a545 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:35.280228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23a2d0-c48c-450d-a107-e3c9aff3a545 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:35.280500 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23a2d0-c48c-450d-a107-e3c9aff3a545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:35.313766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:35.345541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23a2d0-c48c-450d-a107-e3c9aff3a545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:35.347205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23a2d0-c48c-450d-a107-e3c9aff3a545 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:35.372123 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c275-d661-4083-8537-5ab6fbd5f94c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:35.385228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:35.405657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a395cff-e4a4-4879-becc-14b9e06859a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:35.406359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a395cff-e4a4-4879-becc-14b9e06859a8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:35.406647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a395cff-e4a4-4879-becc-14b9e06859a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:35.406924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a395cff-e4a4-4879-becc-14b9e06859a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:35.407674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a395cff-e4a4-4879-becc-14b9e06859a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:35.407979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a395cff-e4a4-4879-becc-14b9e06859a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:35.409539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a395cff-e4a4-4879-becc-14b9e06859a8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:35.417523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 40/82] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:35.418331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a395cff-e4a4-4879-becc-14b9e06859a8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:35.447303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 43/83] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:35.448063 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23a2d0-c48c-450d-a107-e3c9aff3a545 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:35.523924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a395cff-e4a4-4879-becc-14b9e06859a8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:35.530247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:35.559518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a296-2566-46fe-9a55-75bd696ba9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:35.560520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a296-2566-46fe-9a55-75bd696ba9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:35.560800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a296-2566-46fe-9a55-75bd696ba9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:35.561070 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a296-2566-46fe-9a55-75bd696ba9c0 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:35.562255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7a296-2566-46fe-9a55-75bd696ba9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:35.563762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7a296-2566-46fe-9a55-75bd696ba9c0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:35.565023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23a2d0-c48c-450d-a107-e3c9aff3a545 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:35.566119 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 41/84] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:35 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:35.566909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a296-2566-46fe-9a55-75bd696ba9c0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:35.605944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee02887-9784-44ed-ae17-50869eb9c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:35.606880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee02887-9784-44ed-ae17-50869eb9c861 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:35.607166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee02887-9784-44ed-ae17-50869eb9c861 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:35.607445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee02887-9784-44ed-ae17-50869eb9c861 None admin] PATH_INFO: `/v3/users/33ca46aa10824dbdb4be243951ab25d7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:35.608673 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee02887-9784-44ed-ae17-50869eb9c861 None admin] RBAC: Authorizing `identity:get_user(user_id=33ca46aa10824dbdb4be243951ab25d7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:35.609295 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:35.610321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee02887-9784-44ed-ae17-50869eb9c861 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:35.612170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 44/85] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:35 2022] GET /identity/v3/users/33ca46aa10824dbdb4be243951ab25d7 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:35.612994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee02887-9784-44ed-ae17-50869eb9c861 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:35.668862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a296-2566-46fe-9a55-75bd696ba9c0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:35.701620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d058fe7-e60e-4ced-b481-3ae32131c672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:35.702365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058fe7-e60e-4ced-b481-3ae32131c672 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:35.702655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058fe7-e60e-4ced-b481-3ae32131c672 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:35.702934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058fe7-e60e-4ced-b481-3ae32131c672 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:35.704104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d058fe7-e60e-4ced-b481-3ae32131c672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:35.705848 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d058fe7-e60e-4ced-b481-3ae32131c672 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:35.707517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 42/86] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:35.708275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d058fe7-e60e-4ced-b481-3ae32131c672 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:35.719006 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee02887-9784-44ed-ae17-50869eb9c861 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:35.754959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ab6bf-04e8-4244-89d1-36e17983cdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:35.755857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ab6bf-04e8-4244-89d1-36e17983cdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:35.756136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ab6bf-04e8-4244-89d1-36e17983cdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:35.756407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ab6bf-04e8-4244-89d1-36e17983cdb2 None admin] PATH_INFO: `/v3/users/33ca46aa10824dbdb4be243951ab25d7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:35.757614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ab6bf-04e8-4244-89d1-36e17983cdb2 None admin] RBAC: Authorizing `identity:get_user(user_id=33ca46aa10824dbdb4be243951ab25d7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:35.759107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ab6bf-04e8-4244-89d1-36e17983cdb2 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:35.760761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 45/87] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:35 2022] GET /identity/v3/users/33ca46aa10824dbdb4be243951ab25d7 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:35.761518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ab6bf-04e8-4244-89d1-36e17983cdb2 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:35.764903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:35.813840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d058fe7-e60e-4ced-b481-3ae32131c672 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:35.824407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:35.849605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9942-d807-495a-821e-dd1f6bca8d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:35.850504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9942-d807-495a-821e-dd1f6bca8d65 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:35.850775 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9942-d807-495a-821e-dd1f6bca8d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:35.851047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9942-d807-495a-821e-dd1f6bca8d65 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:35.852228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab9942-d807-495a-821e-dd1f6bca8d65 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:35.853699 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab9942-d807-495a-821e-dd1f6bca8d65 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:35.855431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 43/88] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:35 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:35.856185 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9942-d807-495a-821e-dd1f6bca8d65 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:35.863643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ab6bf-04e8-4244-89d1-36e17983cdb2 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:35.907252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109be15-42cf-4825-89c1-d987c35c977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:35.907917 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109be15-42cf-4825-89c1-d987c35c977e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:35.908516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109be15-42cf-4825-89c1-d987c35c977e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:35.909845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109be15-42cf-4825-89c1-d987c35c977e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:35.910728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109be15-42cf-4825-89c1-d987c35c977e None admin] RBAC: Adding query filter params (role.id=86e9a6602f6945d7b87811b8708df6b7, scope.project.id=f24f46abed0346909dcf67babae2c4d8, user.id=33ca46aa10824dbdb4be243951ab25d7) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:35.911040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109be15-42cf-4825-89c1-d987c35c977e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:35.912485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109be15-42cf-4825-89c1-d987c35c977e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:35.920260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 46/89] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:35 2022] GET /identity/v3/role_assignments?user.id=33ca46aa10824dbdb4be243951ab25d7&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:35.921014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109be15-42cf-4825-89c1-d987c35c977e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:35.969693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9942-d807-495a-821e-dd1f6bca8d65 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:36.009807 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5600e5c-54cf-4073-b555-386e05d24450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:36.010539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600e5c-54cf-4073-b555-386e05d24450 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:36.010814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600e5c-54cf-4073-b555-386e05d24450 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:36.011086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600e5c-54cf-4073-b555-386e05d24450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:36.011320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:36.054153 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109be15-42cf-4825-89c1-d987c35c977e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:36.066465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:36.090617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5600e5c-54cf-4073-b555-386e05d24450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:36.092122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5600e5c-54cf-4073-b555-386e05d24450 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:36.097693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c49ad-5c45-4311-aee8-01c8266ee27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:36.098689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c49ad-5c45-4311-aee8-01c8266ee27a None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:36.099171 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c49ad-5c45-4311-aee8-01c8266ee27a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:36.099632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c49ad-5c45-4311-aee8-01c8266ee27a None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:36.101251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c49ad-5c45-4311-aee8-01c8266ee27a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:36.103314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c49ad-5c45-4311-aee8-01c8266ee27a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:36.127254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 47/90] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:03:35 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:36.128172 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c49ad-5c45-4311-aee8-01c8266ee27a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:36.237149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 44/91] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:36.237149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5600e5c-54cf-4073-b555-386e05d24450 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:36.279970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c49ad-5c45-4311-aee8-01c8266ee27a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:36.314212 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:36.328299 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:36.328925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa327945-c8b8-40c7-9c81-0b10cd5b70ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:36.330267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327945-c8b8-40c7-9c81-0b10cd5b70ae None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:36.330715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327945-c8b8-40c7-9c81-0b10cd5b70ae None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:36.330907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327945-c8b8-40c7-9c81-0b10cd5b70ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:36.358341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5600e5c-54cf-4073-b555-386e05d24450 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:36.404032 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0f0c-e9ad-4db9-b47f-99928f8f1de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:36.404032 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0f0c-e9ad-4db9-b47f-99928f8f1de6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:36.404290 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0f0c-e9ad-4db9-b47f-99928f8f1de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:36.404570 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0f0c-e9ad-4db9-b47f-99928f8f1de6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:36.405390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe0f0c-e9ad-4db9-b47f-99928f8f1de6 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=f24f46abed0346909dcf67babae2c4d8, user.id=bb2a4b410c314669afc8739724443fa0) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:36.406505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe0f0c-e9ad-4db9-b47f-99928f8f1de6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:36.408284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe0f0c-e9ad-4db9-b47f-99928f8f1de6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:36.417174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa327945-c8b8-40c7-9c81-0b10cd5b70ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:36.418535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 45/92] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:36 2022] GET /identity/v3/role_assignments?user.id=bb2a4b410c314669afc8739724443fa0&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:36.418711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa327945-c8b8-40c7-9c81-0b10cd5b70ae None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:36.419732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0f0c-e9ad-4db9-b47f-99928f8f1de6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:36.582393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0f0c-e9ad-4db9-b47f-99928f8f1de6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:36.595808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 48/93] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:36.602026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa327945-c8b8-40c7-9c81-0b10cd5b70ae None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:36.628850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07ac3c-d2eb-47dd-ab0d-b8b138d2162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:36.630042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ac3c-d2eb-47dd-ab0d-b8b138d2162a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:36.631296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:36.631636 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ac3c-d2eb-47dd-ab0d-b8b138d2162a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:36.632093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ac3c-d2eb-47dd-ab0d-b8b138d2162a None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:36.633603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07ac3c-d2eb-47dd-ab0d-b8b138d2162a None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:36.635374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07ac3c-d2eb-47dd-ab0d-b8b138d2162a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:36.637323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 46/94] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:36 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:36.644484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07ac3c-d2eb-47dd-ab0d-b8b138d2162a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:36.663377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:36.712217 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa327945-c8b8-40c7-9c81-0b10cd5b70ae None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:36.764061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f3e1f-555b-4035-8171-0362c746481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:36.764963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3e1f-555b-4035-8171-0362c746481a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:36.765240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3e1f-555b-4035-8171-0362c746481a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:36.765508 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3e1f-555b-4035-8171-0362c746481a None admin] PATH_INFO: `/v3/projects/be6d19585b074287a35ca07963807037` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:36.768725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f3e1f-555b-4035-8171-0362c746481a None admin] RBAC: Authorizing `identity:get_project(project_id=be6d19585b074287a35ca07963807037)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:36.771673 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f3e1f-555b-4035-8171-0362c746481a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:36.773443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 49/95] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:36 2022] GET /identity/v3/projects/be6d19585b074287a35ca07963807037 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:36.779227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f3e1f-555b-4035-8171-0362c746481a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:36.803385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07ac3c-d2eb-47dd-ab0d-b8b138d2162a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:36.867139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e013555-0111-4980-a3c9-3b5a80b7e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:36.868012 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e013555-0111-4980-a3c9-3b5a80b7e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:36.868400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e013555-0111-4980-a3c9-3b5a80b7e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:36.868847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e013555-0111-4980-a3c9-3b5a80b7e3a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:36.869798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e013555-0111-4980-a3c9-3b5a80b7e3a9 None admin] RBAC: Adding query filter params (role.id=66ac9c3671cb46b6ae847fdbc68015b3, scope.project.id=f24f46abed0346909dcf67babae2c4d8, user.id=33ca46aa10824dbdb4be243951ab25d7) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:36.870223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e013555-0111-4980-a3c9-3b5a80b7e3a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:36.871822 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e013555-0111-4980-a3c9-3b5a80b7e3a9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:36.878329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 47/96] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:36 2022] GET /identity/v3/role_assignments?user.id=33ca46aa10824dbdb4be243951ab25d7&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=66ac9c3671cb46b6ae847fdbc68015b3 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:36.908900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:36.918960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f3e1f-555b-4035-8171-0362c746481a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:36.970312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5592ffe-2de1-4f49-970f-61dbfc4da8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:36.971362 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5592ffe-2de1-4f49-970f-61dbfc4da8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:36.971884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5592ffe-2de1-4f49-970f-61dbfc4da8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:36.972359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5592ffe-2de1-4f49-970f-61dbfc4da8e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:36.973368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5592ffe-2de1-4f49-970f-61dbfc4da8e7 None admin] RBAC: Adding query filter params (role.id=86e9a6602f6945d7b87811b8708df6b7, scope.project.id=be6d19585b074287a35ca07963807037, user.id=33ca46aa10824dbdb4be243951ab25d7) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:36.973844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5592ffe-2de1-4f49-970f-61dbfc4da8e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:36.975603 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5592ffe-2de1-4f49-970f-61dbfc4da8e7 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:36.987556 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 50/97] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:36 2022] GET /identity/v3/role_assignments?user.id=33ca46aa10824dbdb4be243951ab25d7&scope.project.id=be6d19585b074287a35ca07963807037&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:38.394241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082dd73-ae54-487e-aca6-7306fab17c7b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:38.394780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082dd73-ae54-487e-aca6-7306fab17c7b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:38.394854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082dd73-ae54-487e-aca6-7306fab17c7b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:38.396387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 48/98] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:38.401842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9277fe-9e52-43d3-8327-ba84ae54c036 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:38.402260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9277fe-9e52-43d3-8327-ba84ae54c036 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:38.402453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9277fe-9e52-43d3-8327-ba84ae54c036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:38.422198 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6f9277fe-9e52-43d3-8327-ba84ae54c036 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:38.426964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6f9277fe-9e52-43d3-8327-ba84ae54c036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:38.516113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 51/99] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:38.551149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082dd73-ae54-487e-aca6-7306fab17c7b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:38.639947 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:38.675155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082dd73-ae54-487e-aca6-7306fab17c7b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:38.721389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bc46e-54c5-45ff-a935-93729c199d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:38.722211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bc46e-54c5-45ff-a935-93729c199d42 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:38.722526 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bc46e-54c5-45ff-a935-93729c199d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:38.722808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bc46e-54c5-45ff-a935-93729c199d42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:38.739251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bc46e-54c5-45ff-a935-93729c199d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-ca4bc46e-54c5-45ff-a935-93729c199d42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:38.747600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:38.748942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:38.749704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 49/100] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:38.757153 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9277fe-9e52-43d3-8327-ba84ae54c036 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:38.869458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:38.887273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9277fe-9e52-43d3-8327-ba84ae54c036 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:38.935074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8c729-7474-4414-9269-48dad6f222b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:38.935684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c729-7474-4414-9269-48dad6f222b3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:38.935969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c729-7474-4414-9269-48dad6f222b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:38.936261 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c729-7474-4414-9269-48dad6f222b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:38.937009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8c729-7474-4414-9269-48dad6f222b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:38.937317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8c729-7474-4414-9269-48dad6f222b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:38.938746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8c729-7474-4414-9269-48dad6f222b3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:38.956461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 52/101] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:38.963403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bc46e-54c5-45ff-a935-93729c199d42 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:39.087057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bc46e-54c5-45ff-a935-93729c199d42 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:39.133690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4554d-d138-4891-98c3-e22788c79736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:39.134622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4554d-d138-4891-98c3-e22788c79736 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.134914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4554d-d138-4891-98c3-e22788c79736 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.135195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4554d-d138-4891-98c3-e22788c79736 None admin] PATH_INFO: `/v3/users/33ca46aa10824dbdb4be243951ab25d7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.136429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4554d-d138-4891-98c3-e22788c79736 None admin] RBAC: Authorizing `identity:get_user(user_id=33ca46aa10824dbdb4be243951ab25d7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:39.137914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4554d-d138-4891-98c3-e22788c79736 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:39.139821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 50/102] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:38 2022] GET /identity/v3/users/33ca46aa10824dbdb4be243951ab25d7 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:39.147423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8c729-7474-4414-9269-48dad6f222b3 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:39.262106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ed02d-a241-43cf-851a-164a0cff2452 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.262415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ed02d-a241-43cf-851a-164a0cff2452 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.262601 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ed02d-a241-43cf-851a-164a0cff2452 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.264176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 51/103] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:03:39.269164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5a75c-d1b0-43ef-8b83-72fb7434c227 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.269452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5a75c-d1b0-43ef-8b83-72fb7434c227 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.269743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5a75c-d1b0-43ef-8b83-72fb7434c227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.282524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:39.296126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b3f5a75c-d1b0-43ef-8b83-72fb7434c227 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:39.297522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b3f5a75c-d1b0-43ef-8b83-72fb7434c227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:39.339197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8c729-7474-4414-9269-48dad6f222b3 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:39.424428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 52/104] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:39.427936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da130a6a-eb66-4973-9023-cdfc374f3720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:39.428848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da130a6a-eb66-4973-9023-cdfc374f3720 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.429135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da130a6a-eb66-4973-9023-cdfc374f3720 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.429421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da130a6a-eb66-4973-9023-cdfc374f3720 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.430679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da130a6a-eb66-4973-9023-cdfc374f3720 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:39.432152 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da130a6a-eb66-4973-9023-cdfc374f3720 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:39.434020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 53/105] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:39 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:39.439893 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5a75c-d1b0-43ef-8b83-72fb7434c227 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:39.460674 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da130a6a-eb66-4973-9023-cdfc374f3720 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:39.498658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:39.626787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5a75c-d1b0-43ef-8b83-72fb7434c227 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:39.662383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da130a6a-eb66-4973-9023-cdfc374f3720 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:39.690689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:39.697599 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ad40e-59eb-4696-be4b-1cfa3bcea402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:39.698474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ad40e-59eb-4696-be4b-1cfa3bcea402 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.698763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ad40e-59eb-4696-be4b-1cfa3bcea402 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.698944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a820-fb6b-43d0-a3dc-295029854247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:39.699056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ad40e-59eb-4696-be4b-1cfa3bcea402 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.699865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a820-fb6b-43d0-a3dc-295029854247 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.700148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a820-fb6b-43d0-a3dc-295029854247 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.700470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a820-fb6b-43d0-a3dc-295029854247 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8/users/33ca46aa10824dbdb4be243951ab25d7/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.702749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90a820-fb6b-43d0-a3dc-295029854247 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24f46abed0346909dcf67babae2c4d8, user_id=33ca46aa10824dbdb4be243951ab25d7, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:39.704247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90a820-fb6b-43d0-a3dc-295029854247 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:39.709883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ad40e-59eb-4696-be4b-1cfa3bcea402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-b48ad40e-59eb-4696-be4b-1cfa3bcea402 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:39.717891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:39.718937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:39.720225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 54/106] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:03:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:39.721830 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62cbe0-567c-4270-876e-8e4efe268dbc None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.721830 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62cbe0-567c-4270-876e-8e4efe268dbc None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.721830 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62cbe0-567c-4270-876e-8e4efe268dbc None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.723259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 55/107] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:39.728663 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fb251-18a8-47ef-982c-5d3e85a949d9 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.729025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fb251-18a8-47ef-982c-5d3e85a949d9 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.729371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fb251-18a8-47ef-982c-5d3e85a949d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.735486 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 53/108] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:03:39 2022] PUT /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8/users/33ca46aa10824dbdb4be243951ab25d7/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:03:39.736830 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a820-fb6b-43d0-a3dc-295029854247 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:39.748728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-da4fb251-18a8-47ef-982c-5d3e85a949d9 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:39.750099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-da4fb251-18a8-47ef-982c-5d3e85a949d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:39.823276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 56/109] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:39.824783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b29dd0-671a-4480-88b7-3131ae74e604 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.825174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b29dd0-671a-4480-88b7-3131ae74e604 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.825521 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b29dd0-671a-4480-88b7-3131ae74e604 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.830347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 57/110] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:39.832970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774c3d-e8d7-457b-8df4-e381753fc6d5 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.833356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774c3d-e8d7-457b-8df4-e381753fc6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.833728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774c3d-e8d7-457b-8df4-e381753fc6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.849487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:39.860252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-df774c3d-e8d7-457b-8df4-e381753fc6d5 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:39.861852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-df774c3d-e8d7-457b-8df4-e381753fc6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:39.883005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a820-fb6b-43d0-a3dc-295029854247 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:39.919544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bafcc-f2c9-43d7-a4f8-89ba3961b579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:39.920285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bafcc-f2c9-43d7-a4f8-89ba3961b579 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.920579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bafcc-f2c9-43d7-a4f8-89ba3961b579 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.920867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bafcc-f2c9-43d7-a4f8-89ba3961b579 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.921867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bafcc-f2c9-43d7-a4f8-89ba3961b579 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:39.922235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bafcc-f2c9-43d7-a4f8-89ba3961b579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:39.924146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bafcc-f2c9-43d7-a4f8-89ba3961b579 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:39.933649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 54/111] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:39.935649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39654859-ba12-4b59-9913-2262d7412d8c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:39.935951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39654859-ba12-4b59-9913-2262d7412d8c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:39.936284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39654859-ba12-4b59-9913-2262d7412d8c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:39.938117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 55/112] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:39.939023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39654859-ba12-4b59-9913-2262d7412d8c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:39.955976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 58/113] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:39.956880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df774c3d-e8d7-457b-8df4-e381753fc6d5 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:40.016365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:40.072198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39654859-ba12-4b59-9913-2262d7412d8c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:40.091826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df774c3d-e8d7-457b-8df4-e381753fc6d5 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:40.117089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778009a-76ea-41e0-ab91-9f6c15f5bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:40.118560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778009a-76ea-41e0-ab91-9f6c15f5bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.119044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778009a-76ea-41e0-ab91-9f6c15f5bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.119452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778009a-76ea-41e0-ab91-9f6c15f5bbb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.120903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778009a-76ea-41e0-ab91-9f6c15f5bbb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:40.122993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778009a-76ea-41e0-ab91-9f6c15f5bbb5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:40.125432 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 56/114] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:40.127039 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009988-43ae-4aeb-85ec-04fb0e33658d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.127967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009988-43ae-4aeb-85ec-04fb0e33658d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.128249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009988-43ae-4aeb-85ec-04fb0e33658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.130152 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513a30-8346-4d2e-907a-3fea33b36028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:40.131312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513a30-8346-4d2e-907a-3fea33b36028 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.131595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513a30-8346-4d2e-907a-3fea33b36028 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.131873 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513a30-8346-4d2e-907a-3fea33b36028 None admin] PATH_INFO: `/v3/users/bb2a4b410c314669afc8739724443fa0` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.133328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86513a30-8346-4d2e-907a-3fea33b36028 None admin] RBAC: Authorizing `identity:get_user(user_id=bb2a4b410c314669afc8739724443fa0)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:40.134824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86513a30-8346-4d2e-907a-3fea33b36028 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:40.136785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 59/115] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:39 2022] GET /identity/v3/users/bb2a4b410c314669afc8739724443fa0 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:40.137444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513a30-8346-4d2e-907a-3fea33b36028 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:40.141572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:40.147711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4f009988-43ae-4aeb-85ec-04fb0e33658d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:40.148920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4f009988-43ae-4aeb-85ec-04fb0e33658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:40.235683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 57/116] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:40.236444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009988-43ae-4aeb-85ec-04fb0e33658d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:40.277907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513a30-8346-4d2e-907a-3fea33b36028 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:40.300314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:40.316449 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c3e65-cf15-4a94-ae33-20c3dcd616c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:40.317427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c3e65-cf15-4a94-ae33-20c3dcd616c2 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.317716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c3e65-cf15-4a94-ae33-20c3dcd616c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.318104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c3e65-cf15-4a94-ae33-20c3dcd616c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.329368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c3e65-cf15-4a94-ae33-20c3dcd616c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-9c1c3e65-cf15-4a94-ae33-20c3dcd616c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:40.338308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:40.339177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 60/117] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:40.341110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c3e65-cf15-4a94-ae33-20c3dcd616c2 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:40.355779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009988-43ae-4aeb-85ec-04fb0e33658d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:40.399119 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f15723-f8f5-416e-bf10-0f7a71d14bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:40.399716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f15723-f8f5-416e-bf10-0f7a71d14bc8 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.399991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f15723-f8f5-416e-bf10-0f7a71d14bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.400262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f15723-f8f5-416e-bf10-0f7a71d14bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.400976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f15723-f8f5-416e-bf10-0f7a71d14bc8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:40.402466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f15723-f8f5-416e-bf10-0f7a71d14bc8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:40.412784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:40.430780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 58/118] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:03:40 2022] POST /identity/v3/projects => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:40.432238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f15723-f8f5-416e-bf10-0f7a71d14bc8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:40.461871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c3e65-cf15-4a94-ae33-20c3dcd616c2 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:40.509130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a518f-b5e5-4234-ab0f-32a25e370010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:40.510388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a518f-b5e5-4234-ab0f-32a25e370010 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.510664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a518f-b5e5-4234-ab0f-32a25e370010 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.510985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a518f-b5e5-4234-ab0f-32a25e370010 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.512595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a518f-b5e5-4234-ab0f-32a25e370010 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:40.514767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a518f-b5e5-4234-ab0f-32a25e370010 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:40.516989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 61/119] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:40 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:40.519013 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a518f-b5e5-4234-ab0f-32a25e370010 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:40.577873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f15723-f8f5-416e-bf10-0f7a71d14bc8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:40.581087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:40.630324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7fa82-fc69-4416-a673-9d9fd04e8bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:40.631170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7fa82-fc69-4416-a673-9d9fd04e8bea None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.631451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7fa82-fc69-4416-a673-9d9fd04e8bea None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.631724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7fa82-fc69-4416-a673-9d9fd04e8bea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.646758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7fa82-fc69-4416-a673-9d9fd04e8bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-24e7fa82-fc69-4416-a673-9d9fd04e8bea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:40.654875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:40.655722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:40.656485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 59/120] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:03:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:40.658338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886696bc-0b0f-48da-aaa2-ec5666f499d6 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.658338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886696bc-0b0f-48da-aaa2-ec5666f499d6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.658338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886696bc-0b0f-48da-aaa2-ec5666f499d6 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.661840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 60/121] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:40.661840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886696bc-0b0f-48da-aaa2-ec5666f499d6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:40.666998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a518f-b5e5-4234-ab0f-32a25e370010 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:40.709036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:40.715119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984113e4-2b2b-44ef-9e47-e30bb9f40204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:40.716032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984113e4-2b2b-44ef-9e47-e30bb9f40204 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.716549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984113e4-2b2b-44ef-9e47-e30bb9f40204 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.716889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984113e4-2b2b-44ef-9e47-e30bb9f40204 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.717650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984113e4-2b2b-44ef-9e47-e30bb9f40204 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:40.717956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984113e4-2b2b-44ef-9e47-e30bb9f40204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:40.719647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984113e4-2b2b-44ef-9e47-e30bb9f40204 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:40.730067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 62/122] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:40.730831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984113e4-2b2b-44ef-9e47-e30bb9f40204 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:40.781138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886696bc-0b0f-48da-aaa2-ec5666f499d6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:40.817589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af2b3f-434d-4fb2-b365-f3771c43bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:40.818533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af2b3f-434d-4fb2-b365-f3771c43bea9 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.818820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af2b3f-434d-4fb2-b365-f3771c43bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.819113 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af2b3f-434d-4fb2-b365-f3771c43bea9 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8/users/bb2a4b410c314669afc8739724443fa0/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.821178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af2b3f-434d-4fb2-b365-f3771c43bea9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24f46abed0346909dcf67babae2c4d8, user_id=bb2a4b410c314669afc8739724443fa0, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:40.823695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af2b3f-434d-4fb2-b365-f3771c43bea9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:40.840941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 61/123] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:03:40 2022] PUT /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8/users/bb2a4b410c314669afc8739724443fa0/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:03:40.842043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984113e4-2b2b-44ef-9e47-e30bb9f40204 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:40.842269 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718063-b4a2-47aa-ab41-a8fceea50e63 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.842586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718063-b4a2-47aa-ab41-a8fceea50e63 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.842869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2718063-b4a2-47aa-ab41-a8fceea50e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.869069 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c2718063-b4a2-47aa-ab41-a8fceea50e63 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:40.870550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c2718063-b4a2-47aa-ab41-a8fceea50e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:40.892683 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260118c-48a5-4441-9ccd-60bb3e298a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:40.893863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260118c-48a5-4441-9ccd-60bb3e298a1f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:40.894537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260118c-48a5-4441-9ccd-60bb3e298a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:40.895095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260118c-48a5-4441-9ccd-60bb3e298a1f None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:40.895556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:40.897205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260118c-48a5-4441-9ccd-60bb3e298a1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:40.897699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260118c-48a5-4441-9ccd-60bb3e298a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:40.899621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260118c-48a5-4441-9ccd-60bb3e298a1f None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:40.914075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 63/124] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:03:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:40.915392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260118c-48a5-4441-9ccd-60bb3e298a1f None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:40.993767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 62/125] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:40.994683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2718063-b4a2-47aa-ab41-a8fceea50e63 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:40.999546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:41.055124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260118c-48a5-4441-9ccd-60bb3e298a1f None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:41.097396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c01467-b8f0-4d69-a82a-02de5d7f26a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:41.098324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c01467-b8f0-4d69-a82a-02de5d7f26a8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:41.098621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c01467-b8f0-4d69-a82a-02de5d7f26a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:41.098902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c01467-b8f0-4d69-a82a-02de5d7f26a8 None admin] PATH_INFO: `/v3/users/bcefbc23b26842bf9632da350aba0415` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:41.115575 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c01467-b8f0-4d69-a82a-02de5d7f26a8 None admin] RBAC: Authorizing `identity:get_user(user_id=bcefbc23b26842bf9632da350aba0415)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:41.117540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c01467-b8f0-4d69-a82a-02de5d7f26a8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:41.119354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 64/126] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:40 2022] GET /identity/v3/users/bcefbc23b26842bf9632da350aba0415 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:41.120182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c01467-b8f0-4d69-a82a-02de5d7f26a8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:41.142917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2718063-b4a2-47aa-ab41-a8fceea50e63 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:41.185800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f1057-4976-40a5-88a4-ac4860399afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:41.187112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f1057-4976-40a5-88a4-ac4860399afa None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:41.187402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f1057-4976-40a5-88a4-ac4860399afa None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:41.187945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f1057-4976-40a5-88a4-ac4860399afa None admin] PATH_INFO: `/v3/users/33ca46aa10824dbdb4be243951ab25d7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:41.189357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f1057-4976-40a5-88a4-ac4860399afa None admin] RBAC: Authorizing `identity:get_user(user_id=33ca46aa10824dbdb4be243951ab25d7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:41.191822 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f1057-4976-40a5-88a4-ac4860399afa None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:41.194320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 63/127] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:40 2022] GET /identity/v3/users/33ca46aa10824dbdb4be243951ab25d7 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:41.194900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f1057-4976-40a5-88a4-ac4860399afa None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:41.226744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:41.248517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c01467-b8f0-4d69-a82a-02de5d7f26a8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:41.269182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:41.302216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496b3a9-4f5d-4228-b0af-1f7c67d338a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:41.305679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496b3a9-4f5d-4228-b0af-1f7c67d338a0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:41.305971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496b3a9-4f5d-4228-b0af-1f7c67d338a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:41.306250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496b3a9-4f5d-4228-b0af-1f7c67d338a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:41.324561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f1057-4976-40a5-88a4-ac4860399afa None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:41.333382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496b3a9-4f5d-4228-b0af-1f7c67d338a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-0496b3a9-4f5d-4228-b0af-1f7c67d338a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:41.342540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:41.343425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:41.344187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:41.345871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 65/128] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:41.347853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496b3a9-4f5d-4228-b0af-1f7c67d338a0 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:41.422881 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373f58b-907f-4ca6-87e9-f7ffe4bd416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:41.423404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373f58b-907f-4ca6-87e9-f7ffe4bd416f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:41.423723 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373f58b-907f-4ca6-87e9-f7ffe4bd416f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:41.424011 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373f58b-907f-4ca6-87e9-f7ffe4bd416f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:41.468314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496b3a9-4f5d-4228-b0af-1f7c67d338a0 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:41.512147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df841c-06ce-409b-b59c-b5ce8f2f1ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:41.518963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df841c-06ce-409b-b59c-b5ce8f2f1ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:41.519544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df841c-06ce-409b-b59c-b5ce8f2f1ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:41.520025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df841c-06ce-409b-b59c-b5ce8f2f1ae8 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:41.521623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df841c-06ce-409b-b59c-b5ce8f2f1ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:41.523335 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df841c-06ce-409b-b59c-b5ce8f2f1ae8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:41.527774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 66/129] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:41 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:41.530359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df841c-06ce-409b-b59c-b5ce8f2f1ae8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:41.603395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373f58b-907f-4ca6-87e9-f7ffe4bd416f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:41.604964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373f58b-907f-4ca6-87e9-f7ffe4bd416f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:41.620695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:41.684281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:41.688154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df841c-06ce-409b-b59c-b5ce8f2f1ae8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:41.730853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe9d2f-98e3-41db-ad17-b041c7f6fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:41.732156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9d2f-98e3-41db-ad17-b041c7f6fca0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:41.733048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9d2f-98e3-41db-ad17-b041c7f6fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:41.733765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9d2f-98e3-41db-ad17-b041c7f6fca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:41.735046 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe9d2f-98e3-41db-ad17-b041c7f6fca0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:41.735979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe9d2f-98e3-41db-ad17-b041c7f6fca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:41.738392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe9d2f-98e3-41db-ad17-b041c7f6fca0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:41.751609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 67/130] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:41.753655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe9d2f-98e3-41db-ad17-b041c7f6fca0 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:41.865448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 64/131] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:41.865448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373f58b-907f-4ca6-87e9-f7ffe4bd416f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:41.871278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe9d2f-98e3-41db-ad17-b041c7f6fca0 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:41.876545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:41.913333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19d2e1-172e-406d-8821-e8cdad92095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:41.914680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19d2e1-172e-406d-8821-e8cdad92095e None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:41.915655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19d2e1-172e-406d-8821-e8cdad92095e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:41.916134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19d2e1-172e-406d-8821-e8cdad92095e None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8/users/33ca46aa10824dbdb4be243951ab25d7/roles/66ac9c3671cb46b6ae847fdbc68015b3` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:41.919263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19d2e1-172e-406d-8821-e8cdad92095e None admin] RBAC: Authorizing `identity:create_grant(project_id=f24f46abed0346909dcf67babae2c4d8, user_id=33ca46aa10824dbdb4be243951ab25d7, role_id=66ac9c3671cb46b6ae847fdbc68015b3)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:41.921000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19d2e1-172e-406d-8821-e8cdad92095e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:41.937940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 68/132] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:03:41 2022] PUT /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8/users/33ca46aa10824dbdb4be243951ab25d7/roles/66ac9c3671cb46b6ae847fdbc68015b3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:03:41.939535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19d2e1-172e-406d-8821-e8cdad92095e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:42.070029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19d2e1-172e-406d-8821-e8cdad92095e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:42.109978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646197e4-f999-443d-bcc7-d5851f99b77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:42.111101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646197e4-f999-443d-bcc7-d5851f99b77a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:42.111608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646197e4-f999-443d-bcc7-d5851f99b77a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:42.112516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646197e4-f999-443d-bcc7-d5851f99b77a None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:42.114023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646197e4-f999-443d-bcc7-d5851f99b77a None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:42.116838 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646197e4-f999-443d-bcc7-d5851f99b77a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:42.119039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 69/133] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:41 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:42.125085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646197e4-f999-443d-bcc7-d5851f99b77a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:42.166470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:42.211717 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373f58b-907f-4ca6-87e9-f7ffe4bd416f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:42.240960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646197e4-f999-443d-bcc7-d5851f99b77a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:42.253514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:42.268870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872a7cf-bb45-4033-acaf-d5ed6b92ed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:42.270038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a7cf-bb45-4033-acaf-d5ed6b92ed5f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:42.270345 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a7cf-bb45-4033-acaf-d5ed6b92ed5f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:42.270883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a7cf-bb45-4033-acaf-d5ed6b92ed5f None admin] PATH_INFO: `/v3/users/33ca46aa10824dbdb4be243951ab25d7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:42.272653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872a7cf-bb45-4033-acaf-d5ed6b92ed5f None admin] RBAC: Authorizing `identity:get_user(user_id=33ca46aa10824dbdb4be243951ab25d7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:42.274558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872a7cf-bb45-4033-acaf-d5ed6b92ed5f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:42.277431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 65/134] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:41 2022] GET /identity/v3/users/33ca46aa10824dbdb4be243951ab25d7 => generated 275 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:42.278890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cde7c7-ae8d-41af-af4d-84fadd2daa25 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:42.279178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cde7c7-ae8d-41af-af4d-84fadd2daa25 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:42.279454 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cde7c7-ae8d-41af-af4d-84fadd2daa25 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:42.280866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 66/135] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:42.284760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cde7c7-ae8d-41af-af4d-84fadd2daa25 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:42.291555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc271c-94c6-4ea5-bc27-7524595a27c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:42.292230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc271c-94c6-4ea5-bc27-7524595a27c7 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:42.292510 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc271c-94c6-4ea5-bc27-7524595a27c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:42.292779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc271c-94c6-4ea5-bc27-7524595a27c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:42.293615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc271c-94c6-4ea5-bc27-7524595a27c7 None admin] RBAC: Adding query filter params (role.id=5c5cdc6f15a846a0829e831d6a8949d4, scope.project.id=f24f46abed0346909dcf67babae2c4d8, user.id=bcefbc23b26842bf9632da350aba0415) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:42.293925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc271c-94c6-4ea5-bc27-7524595a27c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:42.295398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc271c-94c6-4ea5-bc27-7524595a27c7 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:42.302212 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 70/136] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:42 2022] GET /identity/v3/role_assignments?user.id=bcefbc23b26842bf9632da350aba0415&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=5c5cdc6f15a846a0829e831d6a8949d4 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:42.306079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf812e-42c3-4472-93d9-5b16aef72c09 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:42.306399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf812e-42c3-4472-93d9-5b16aef72c09 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:42.306696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf812e-42c3-4472-93d9-5b16aef72c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:42.344279 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f2cf812e-42c3-4472-93d9-5b16aef72c09 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:42.345478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f2cf812e-42c3-4472-93d9-5b16aef72c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:42.467258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 71/137] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:42.494030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cde7c7-ae8d-41af-af4d-84fadd2daa25 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:42.508488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf812e-42c3-4472-93d9-5b16aef72c09 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:42.569280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:42.597384 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acc922-a256-4811-a2a2-e453e0943e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:42.598317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc922-a256-4811-a2a2-e453e0943e6c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:42.598613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc922-a256-4811-a2a2-e453e0943e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:42.598939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc922-a256-4811-a2a2-e453e0943e6c None admin] PATH_INFO: `/v3/projects/be6d19585b074287a35ca07963807037` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:42.600484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acc922-a256-4811-a2a2-e453e0943e6c None admin] RBAC: Authorizing `identity:get_project(project_id=be6d19585b074287a35ca07963807037)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:42.604075 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acc922-a256-4811-a2a2-e453e0943e6c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:42.608488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 67/138] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:42 2022] GET /identity/v3/projects/be6d19585b074287a35ca07963807037 => generated 312 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:42.613854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acc922-a256-4811-a2a2-e453e0943e6c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:42.693454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf812e-42c3-4472-93d9-5b16aef72c09 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:42.734060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c19082-8320-4776-8d1c-c3b89c13dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:42.734916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c19082-8320-4776-8d1c-c3b89c13dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:42.735197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c19082-8320-4776-8d1c-c3b89c13dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:42.735470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c19082-8320-4776-8d1c-c3b89c13dbe1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:42.758274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c19082-8320-4776-8d1c-c3b89c13dbe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:42.766487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-45c19082-8320-4776-8d1c-c3b89c13dbe1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:42.771940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:42.772806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:42.773549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:42.778505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 72/139] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:42.784681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c19082-8320-4776-8d1c-c3b89c13dbe1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:42.845157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acc922-a256-4811-a2a2-e453e0943e6c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:42.917642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015e9aa-a595-408c-b1ae-837b69e84a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:42.918579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015e9aa-a595-408c-b1ae-837b69e84a83 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:42.918862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015e9aa-a595-408c-b1ae-837b69e84a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:42.919135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015e9aa-a595-408c-b1ae-837b69e84a83 None admin] PATH_INFO: `/v3/projects/be6d19585b074287a35ca07963807037/users/33ca46aa10824dbdb4be243951ab25d7/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:42.921106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015e9aa-a595-408c-b1ae-837b69e84a83 None admin] RBAC: Authorizing `identity:create_grant(project_id=be6d19585b074287a35ca07963807037, user_id=33ca46aa10824dbdb4be243951ab25d7, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:42.926640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015e9aa-a595-408c-b1ae-837b69e84a83 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:42.929536 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:42.943209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c19082-8320-4776-8d1c-c3b89c13dbe1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:42.964481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 68/140] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:03:42 2022] PUT /identity/v3/projects/be6d19585b074287a35ca07963807037/users/33ca46aa10824dbdb4be243951ab25d7/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:03:42.983487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9a709-5769-429e-851e-2bd4831e1b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:42.984199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9a709-5769-429e-851e-2bd4831e1b75 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:42.984480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9a709-5769-429e-851e-2bd4831e1b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:42.984751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9a709-5769-429e-851e-2bd4831e1b75 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:42.985535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9a709-5769-429e-851e-2bd4831e1b75 None admin] RBAC: Adding query filter params (name=member) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:42.985887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9a709-5769-429e-851e-2bd4831e1b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:42.988053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9a709-5769-429e-851e-2bd4831e1b75 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:42.992033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e80fe8-e085-46ca-9c8b-96b2c24e1023 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:42.992320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e80fe8-e085-46ca-9c8b-96b2c24e1023 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:42.992595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e80fe8-e085-46ca-9c8b-96b2c24e1023 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:42.994113 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 69/141] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:03:42.997780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 73/142] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:42.999619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb170e-4498-448d-b124-46201f294b09 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:42.999956 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb170e-4498-448d-b124-46201f294b09 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:43.000231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb170e-4498-448d-b124-46201f294b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:43.005664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9a709-5769-429e-851e-2bd4831e1b75 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:43.032648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7beb170e-4498-448d-b124-46201f294b09 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:43.034194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7beb170e-4498-448d-b124-46201f294b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:43.211748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9a709-5769-429e-851e-2bd4831e1b75 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:43.227070 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 70/143] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:43.256644 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028cfff-6c81-465b-9330-9307e21a1008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:43.257565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028cfff-6c81-465b-9330-9307e21a1008 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:43.257840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028cfff-6c81-465b-9330-9307e21a1008 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:43.258116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028cfff-6c81-465b-9330-9307e21a1008 None admin] PATH_INFO: `/v3/users/33ca46aa10824dbdb4be243951ab25d7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:43.259352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028cfff-6c81-465b-9330-9307e21a1008 None admin] RBAC: Authorizing `identity:get_user(user_id=33ca46aa10824dbdb4be243951ab25d7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:43.260820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028cfff-6c81-465b-9330-9307e21a1008 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:43.262817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 74/144] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:43 2022] GET /identity/v3/users/33ca46aa10824dbdb4be243951ab25d7 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:43.268925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb170e-4498-448d-b124-46201f294b09 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:43.272740 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028cfff-6c81-465b-9330-9307e21a1008 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:43.306478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:43.335394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:43.402260 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb170e-4498-448d-b124-46201f294b09 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:43.450611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028cfff-6c81-465b-9330-9307e21a1008 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:43.465308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98319d-fc63-4341-b8c5-728f26b45d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:43.465902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98319d-fc63-4341-b8c5-728f26b45d06 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:43.466188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98319d-fc63-4341-b8c5-728f26b45d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:43.468370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98319d-fc63-4341-b8c5-728f26b45d06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:43.514683 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1bc8f-4b61-459e-9d51-323d42794ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:43.515505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1bc8f-4b61-459e-9d51-323d42794ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:43.515785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1bc8f-4b61-459e-9d51-323d42794ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:43.516055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1bc8f-4b61-459e-9d51-323d42794ba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:43.518342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1bc8f-4b61-459e-9d51-323d42794ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:43.519910 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1bc8f-4b61-459e-9d51-323d42794ba2 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:43.526207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 75/145] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:43.527539 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1bc8f-4b61-459e-9d51-323d42794ba2 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:43.618130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98319d-fc63-4341-b8c5-728f26b45d06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:43.620647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98319d-fc63-4341-b8c5-728f26b45d06 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:43.687722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:43.729032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:43.743549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 71/146] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:43.749307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98319d-fc63-4341-b8c5-728f26b45d06 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:43.764901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1bc8f-4b61-459e-9d51-323d42794ba2 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:43.829357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b12c9-5338-4ecd-8e5e-c8cfe6c85e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:43.829961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b12c9-5338-4ecd-8e5e-c8cfe6c85e77 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:43.830237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b12c9-5338-4ecd-8e5e-c8cfe6c85e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:43.830652 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b12c9-5338-4ecd-8e5e-c8cfe6c85e77 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:43.831464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b12c9-5338-4ecd-8e5e-c8cfe6c85e77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:43.832912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b12c9-5338-4ecd-8e5e-c8cfe6c85e77 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:43.858215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98319d-fc63-4341-b8c5-728f26b45d06 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:43.878523 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 76/147] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:03:43 2022] POST /identity/v3/users => generated 283 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:43.898764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584db83-60d3-492c-9f64-17c4454b6621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:43.900118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584db83-60d3-492c-9f64-17c4454b6621 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:43.900615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584db83-60d3-492c-9f64-17c4454b6621 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:43.901153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584db83-60d3-492c-9f64-17c4454b6621 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:43.902724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584db83-60d3-492c-9f64-17c4454b6621 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:43.904528 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584db83-60d3-492c-9f64-17c4454b6621 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:43.907055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 72/148] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:43 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:43.913608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b12c9-5338-4ecd-8e5e-c8cfe6c85e77 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:44.053093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b12c9-5338-4ecd-8e5e-c8cfe6c85e77 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:44.102323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8ce50-6687-473c-adc4-7e659e327488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:44.103365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8ce50-6687-473c-adc4-7e659e327488 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:44.103854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8ce50-6687-473c-adc4-7e659e327488 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:44.104308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8ce50-6687-473c-adc4-7e659e327488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:44.105418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8ce50-6687-473c-adc4-7e659e327488 None admin] RBAC: Adding query filter params (role.id=86e9a6602f6945d7b87811b8708df6b7, scope.project.id=f24f46abed0346909dcf67babae2c4d8, user.id=33ca46aa10824dbdb4be243951ab25d7) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:44.105953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8ce50-6687-473c-adc4-7e659e327488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:44.107606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8ce50-6687-473c-adc4-7e659e327488 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:44.119303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 77/149] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:43 2022] GET /identity/v3/role_assignments?user.id=33ca46aa10824dbdb4be243951ab25d7&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:44.208101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990637f-4fbb-4926-866e-54a7283eae19 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:44.208433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990637f-4fbb-4926-866e-54a7283eae19 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:44.208660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990637f-4fbb-4926-866e-54a7283eae19 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:44.210091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 73/150] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:44.215883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054a660-e8ec-4627-b2c2-92bb803f0905 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:44.216514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054a660-e8ec-4627-b2c2-92bb803f0905 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:44.217000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054a660-e8ec-4627-b2c2-92bb803f0905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:44.227598 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:44.243227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-0054a660-e8ec-4627-b2c2-92bb803f0905 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:44.244862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-0054a660-e8ec-4627-b2c2-92bb803f0905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:44.331557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 78/151] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:44.354870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990637f-4fbb-4926-866e-54a7283eae19 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:44.378825 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:44.490857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990637f-4fbb-4926-866e-54a7283eae19 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:44.532412 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f53b26-f4bb-4f99-95da-bef9fbdae7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:44.533357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f53b26-f4bb-4f99-95da-bef9fbdae7da None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:44.533890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f53b26-f4bb-4f99-95da-bef9fbdae7da None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:44.534171 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f53b26-f4bb-4f99-95da-bef9fbdae7da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:44.546646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f53b26-f4bb-4f99-95da-bef9fbdae7da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d9f53b26-f4bb-4f99-95da-bef9fbdae7da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:44.554616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:44.555459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:44.556662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 74/152] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:03:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:44.561634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054a660-e8ec-4627-b2c2-92bb803f0905 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:44.687226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054a660-e8ec-4627-b2c2-92bb803f0905 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:44.724726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f928b-a35e-4128-ba78-5b783dbe0b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:44.725418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f928b-a35e-4128-ba78-5b783dbe0b54 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:44.725691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f928b-a35e-4128-ba78-5b783dbe0b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:44.725963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f928b-a35e-4128-ba78-5b783dbe0b54 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:44.726754 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f928b-a35e-4128-ba78-5b783dbe0b54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:44.727059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f928b-a35e-4128-ba78-5b783dbe0b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:44.728442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f928b-a35e-4128-ba78-5b783dbe0b54 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:44.729934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:44.742338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 79/153] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:44.748106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f53b26-f4bb-4f99-95da-bef9fbdae7da None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:44.808324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebecef-1a81-4486-9901-434baffcd392 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:44.808631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebecef-1a81-4486-9901-434baffcd392 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:44.808880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebecef-1a81-4486-9901-434baffcd392 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:44.810270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 80/154] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:44.831134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7cad7-224f-4b01-b34a-44629de7f1bb None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:44.831487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7cad7-224f-4b01-b34a-44629de7f1bb None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:44.831681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7cad7-224f-4b01-b34a-44629de7f1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:44.848567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-37d7cad7-224f-4b01-b34a-44629de7f1bb None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:44.849743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-37d7cad7-224f-4b01-b34a-44629de7f1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:44.891448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:44.935686 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 81/155] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:44.937179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f53b26-f4bb-4f99-95da-bef9fbdae7da None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:44.978734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7cad7-224f-4b01-b34a-44629de7f1bb None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:44.980064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89007cd4-0dbd-4114-a14e-7550d3f12f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:44.980969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007cd4-0dbd-4114-a14e-7550d3f12f01 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:44.981251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007cd4-0dbd-4114-a14e-7550d3f12f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:44.981528 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007cd4-0dbd-4114-a14e-7550d3f12f01 None admin] PATH_INFO: `/v3/users/bb2a4b410c314669afc8739724443fa0` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:44.991495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89007cd4-0dbd-4114-a14e-7550d3f12f01 None admin] RBAC: Authorizing `identity:get_user(user_id=bb2a4b410c314669afc8739724443fa0)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:44.992999 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89007cd4-0dbd-4114-a14e-7550d3f12f01 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:44.994891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 75/156] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:44 2022] GET /identity/v3/users/bb2a4b410c314669afc8739724443fa0 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:45.000331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89007cd4-0dbd-4114-a14e-7550d3f12f01 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:45.111110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7cad7-224f-4b01-b34a-44629de7f1bb None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:45.142329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:45.152795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5106f3-fbc9-413c-9ab4-f0b3201b746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:45.153675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5106f3-fbc9-413c-9ab4-f0b3201b746b None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:45.153955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5106f3-fbc9-413c-9ab4-f0b3201b746b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:45.154221 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5106f3-fbc9-413c-9ab4-f0b3201b746b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:45.174630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5106f3-fbc9-413c-9ab4-f0b3201b746b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-da5106f3-fbc9-413c-9ab4-f0b3201b746b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:45.186641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:45.187860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:45.188706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:45.196252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 82/157] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:03:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:03:45.206842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5106f3-fbc9-413c-9ab4-f0b3201b746b None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:45.249941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89007cd4-0dbd-4114-a14e-7550d3f12f01 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:45.305332 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d5035-a347-427f-abd7-781020b42d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:45.306008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d5035-a347-427f-abd7-781020b42d35 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:45.306302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d5035-a347-427f-abd7-781020b42d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:45.306665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d5035-a347-427f-abd7-781020b42d35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:45.335505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:45.400080 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5106f3-fbc9-413c-9ab4-f0b3201b746b None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:45.448036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d5035-a347-427f-abd7-781020b42d35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:45.449550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d5035-a347-427f-abd7-781020b42d35 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:45.453480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1020-7310-45e3-95f5-ab5efa87f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:45.454176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1020-7310-45e3-95f5-ab5efa87f167 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:45.454504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1020-7310-45e3-95f5-ab5efa87f167 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:45.454773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1020-7310-45e3-95f5-ab5efa87f167 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:45.455919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e1020-7310-45e3-95f5-ab5efa87f167 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:45.456026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e1020-7310-45e3-95f5-ab5efa87f167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:45.457403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e1020-7310-45e3-95f5-ab5efa87f167 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:45.466325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 83/158] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:03:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:45.475414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1020-7310-45e3-95f5-ab5efa87f167 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:45.546555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:45.621561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1020-7310-45e3-95f5-ab5efa87f167 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:45.625215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 76/159] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 03:03:45.626614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe248f-a189-452b-a2b3-f3f13bd9e6a7 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:45.626971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe248f-a189-452b-a2b3-f3f13bd9e6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:45.627347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe248f-a189-452b-a2b3-f3f13bd9e6a7 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:45.628545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 77/160] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:45.635718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf920fe-3a4a-49b5-84c6-c3f25b9694fc None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:45.636372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf920fe-3a4a-49b5-84c6-c3f25b9694fc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:45.636832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf920fe-3a4a-49b5-84c6-c3f25b9694fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:45.657494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e426d-cf19-40f5-91b6-cd1e1e56297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:45.662313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e426d-cf19-40f5-91b6-cd1e1e56297e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:45.662313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e426d-cf19-40f5-91b6-cd1e1e56297e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:45.662313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e426d-cf19-40f5-91b6-cd1e1e56297e None admin] PATH_INFO: `/v3/users/33ca46aa10824dbdb4be243951ab25d7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:45.662313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e426d-cf19-40f5-91b6-cd1e1e56297e None admin] RBAC: Authorizing `identity:get_user(user_id=33ca46aa10824dbdb4be243951ab25d7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:45.662313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e426d-cf19-40f5-91b6-cd1e1e56297e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:45.663452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 84/161] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:45 2022] GET /identity/v3/users/33ca46aa10824dbdb4be243951ab25d7 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:45.667522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e426d-cf19-40f5-91b6-cd1e1e56297e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:45.676022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-bbf920fe-3a4a-49b5-84c6-c3f25b9694fc None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:45.677477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bbf920fe-3a4a-49b5-84c6-c3f25b9694fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:45.766272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:45.775463 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e426d-cf19-40f5-91b6-cd1e1e56297e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:45.792482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:45.812166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d1b1-a814-4636-8f59-55b8ba810d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:45.812973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d1b1-a814-4636-8f59-55b8ba810d60 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:45.813253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d1b1-a814-4636-8f59-55b8ba810d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:45.813522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d1b1-a814-4636-8f59-55b8ba810d60 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:45.814906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56d1b1-a814-4636-8f59-55b8ba810d60 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:45.816326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56d1b1-a814-4636-8f59-55b8ba810d60 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:45.818548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 85/162] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:45 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:45.819341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d1b1-a814-4636-8f59-55b8ba810d60 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:45.823215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 78/163] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:45.826494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf920fe-3a4a-49b5-84c6-c3f25b9694fc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:45.940137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d1b1-a814-4636-8f59-55b8ba810d60 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:46.010888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45aba-e67d-48cd-8ea4-0f97cc6c7d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:46.011557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45aba-e67d-48cd-8ea4-0f97cc6c7d2f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:46.011834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45aba-e67d-48cd-8ea4-0f97cc6c7d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:46.012103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45aba-e67d-48cd-8ea4-0f97cc6c7d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:46.024772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf920fe-3a4a-49b5-84c6-c3f25b9694fc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:46.107750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adce6d-24d3-4369-a7f1-7e1960ef81af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:46.108341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adce6d-24d3-4369-a7f1-7e1960ef81af None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:46.110744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adce6d-24d3-4369-a7f1-7e1960ef81af None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:46.111034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adce6d-24d3-4369-a7f1-7e1960ef81af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:46.113309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adce6d-24d3-4369-a7f1-7e1960ef81af None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=f24f46abed0346909dcf67babae2c4d8, user.id=bb2a4b410c314669afc8739724443fa0) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:46.113624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adce6d-24d3-4369-a7f1-7e1960ef81af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:46.121209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adce6d-24d3-4369-a7f1-7e1960ef81af None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:46.132204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:46.141919 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 79/164] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:45 2022] GET /identity/v3/role_assignments?user.id=bb2a4b410c314669afc8739724443fa0&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:46.145583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adce6d-24d3-4369-a7f1-7e1960ef81af None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:46.183179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce45aba-e67d-48cd-8ea4-0f97cc6c7d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:46.186165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce45aba-e67d-48cd-8ea4-0f97cc6c7d2f None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:46.250363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:46.367436 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adce6d-24d3-4369-a7f1-7e1960ef81af None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:46.402243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 86/165] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:46.403706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f562a2-c419-4894-8931-1c491321c85e None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:46.404001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f562a2-c419-4894-8931-1c491321c85e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:46.404276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f562a2-c419-4894-8931-1c491321c85e None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:46.406067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 87/166] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:46.411037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f562a2-c419-4894-8931-1c491321c85e None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:46.437014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02a3c-e559-4a3e-a3ae-85ac18de9c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:46.438095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02a3c-e559-4a3e-a3ae-85ac18de9c0d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:46.438679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02a3c-e559-4a3e-a3ae-85ac18de9c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:46.439085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02a3c-e559-4a3e-a3ae-85ac18de9c0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:46.461390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02a3c-e559-4a3e-a3ae-85ac18de9c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-cca02a3c-e559-4a3e-a3ae-85ac18de9c0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:46.474314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:46.475400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:03:46.476549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:46.479135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 80/167] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:46.480540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaf94a-1b8e-4ec8-b28c-ba833c2e4646 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:46.480945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaf94a-1b8e-4ec8-b28c-ba833c2e4646 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:46.481364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaf94a-1b8e-4ec8-b28c-ba833c2e4646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:46.515778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c9eaf94a-1b8e-4ec8-b28c-ba833c2e4646 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:46.516990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c9eaf94a-1b8e-4ec8-b28c-ba833c2e4646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:46.522643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:46.583538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f562a2-c419-4894-8931-1c491321c85e None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:46.595555 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 81/168] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:46.596525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaf94a-1b8e-4ec8-b28c-ba833c2e4646 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:46.638527 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:46.679454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175f0e6-7c3b-4bab-9461-d51951bd64c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:46.680354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175f0e6-7c3b-4bab-9461-d51951bd64c1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:46.680669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175f0e6-7c3b-4bab-9461-d51951bd64c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:46.680939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175f0e6-7c3b-4bab-9461-d51951bd64c1 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:46.686507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175f0e6-7c3b-4bab-9461-d51951bd64c1 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:46.687984 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175f0e6-7c3b-4bab-9461-d51951bd64c1 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:46.690664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 88/169] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:46 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:46.691482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175f0e6-7c3b-4bab-9461-d51951bd64c1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:46.730414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaf94a-1b8e-4ec8-b28c-ba833c2e4646 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:46.766763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1b10-455c-4c97-beaa-751b89afc0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:46.768159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1b10-455c-4c97-beaa-751b89afc0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:46.768583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1b10-455c-4c97-beaa-751b89afc0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:46.769084 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d1b10-455c-4c97-beaa-751b89afc0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:46.770049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1b10-455c-4c97-beaa-751b89afc0f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:46.770530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1b10-455c-4c97-beaa-751b89afc0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:46.772074 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d1b10-455c-4c97-beaa-751b89afc0f5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:46.781396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 82/170] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:46.786624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1b10-455c-4c97-beaa-751b89afc0f5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:46.882791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:46.893570 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d1b10-455c-4c97-beaa-751b89afc0f5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:46.903256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175f0e6-7c3b-4bab-9461-d51951bd64c1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:46.947227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da8f30-f387-4765-8c27-aafa341e4262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:46.948182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8f30-f387-4765-8c27-aafa341e4262 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:46.948630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8f30-f387-4765-8c27-aafa341e4262 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:46.949043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da8f30-f387-4765-8c27-aafa341e4262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:46.950028 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da8f30-f387-4765-8c27-aafa341e4262 None admin] RBAC: Adding query filter params (role.id=66ac9c3671cb46b6ae847fdbc68015b3, scope.project.id=f24f46abed0346909dcf67babae2c4d8, user.id=33ca46aa10824dbdb4be243951ab25d7) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:46.950495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da8f30-f387-4765-8c27-aafa341e4262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:46.952220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da8f30-f387-4765-8c27-aafa341e4262 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:46.959074 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 83/171] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:46 2022] GET /identity/v3/role_assignments?user.id=33ca46aa10824dbdb4be243951ab25d7&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=66ac9c3671cb46b6ae847fdbc68015b3 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:46.960187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da8f30-f387-4765-8c27-aafa341e4262 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:46.991429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab579c-8f0f-41cb-b84a-35f057650340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:46.992425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab579c-8f0f-41cb-b84a-35f057650340 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:46.992815 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab579c-8f0f-41cb-b84a-35f057650340 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:46.993174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab579c-8f0f-41cb-b84a-35f057650340 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:47.031327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab579c-8f0f-41cb-b84a-35f057650340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-89ab579c-8f0f-41cb-b84a-35f057650340 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:47.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:47.040752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:47.041531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 89/172] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:47.051359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab579c-8f0f-41cb-b84a-35f057650340 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:47.096333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:47.126582 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da8f30-f387-4765-8c27-aafa341e4262 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:47.220069 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262688-1f91-416e-acf6-1958ecbe3375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:47.221085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262688-1f91-416e-acf6-1958ecbe3375 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:47.221367 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262688-1f91-416e-acf6-1958ecbe3375 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:47.221639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262688-1f91-416e-acf6-1958ecbe3375 None admin] PATH_INFO: `/v3/users/bcefbc23b26842bf9632da350aba0415` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:47.223815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262688-1f91-416e-acf6-1958ecbe3375 None admin] RBAC: Authorizing `identity:get_user(user_id=bcefbc23b26842bf9632da350aba0415)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:47.225294 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262688-1f91-416e-acf6-1958ecbe3375 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:47.227005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 84/173] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:46 2022] GET /identity/v3/users/bcefbc23b26842bf9632da350aba0415 => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:47.232742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262688-1f91-416e-acf6-1958ecbe3375 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:47.272437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab579c-8f0f-41cb-b84a-35f057650340 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:47.288990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:47.307511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00966411-d018-4e3c-be6a-b2321b13f698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:47.308572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00966411-d018-4e3c-be6a-b2321b13f698 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:47.309047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00966411-d018-4e3c-be6a-b2321b13f698 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:47.309511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00966411-d018-4e3c-be6a-b2321b13f698 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:47.310495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00966411-d018-4e3c-be6a-b2321b13f698 None admin] RBAC: Adding query filter params (name=member) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:47.311026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00966411-d018-4e3c-be6a-b2321b13f698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:47.312597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00966411-d018-4e3c-be6a-b2321b13f698 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:47.322022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 90/174] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:47.323774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78180e72-9c64-46ac-b54c-b5f5aa1590e9 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:47.324263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78180e72-9c64-46ac-b54c-b5f5aa1590e9 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:47.324728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78180e72-9c64-46ac-b54c-b5f5aa1590e9 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:47.326200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 91/175] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:47.328413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78180e72-9c64-46ac-b54c-b5f5aa1590e9 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:47.389641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262688-1f91-416e-acf6-1958ecbe3375 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:47.406540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:47.429495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a26f44-c99b-4060-973f-872849e5fa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:47.430531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a26f44-c99b-4060-973f-872849e5fa41 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:47.430807 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a26f44-c99b-4060-973f-872849e5fa41 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:47.431076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a26f44-c99b-4060-973f-872849e5fa41 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:47.432296 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a26f44-c99b-4060-973f-872849e5fa41 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:47.433797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a26f44-c99b-4060-973f-872849e5fa41 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:47.434915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78180e72-9c64-46ac-b54c-b5f5aa1590e9 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:47.435552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 85/176] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:47 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:47.436679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d9bc8-692d-4bb8-8594-14b699201a28 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:47.437097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d9bc8-692d-4bb8-8594-14b699201a28 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:47.437371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d9bc8-692d-4bb8-8594-14b699201a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:47.456291 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-378d9bc8-692d-4bb8-8594-14b699201a28 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:47.457468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-378d9bc8-692d-4bb8-8594-14b699201a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:47.473400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ec376-af63-4506-a366-2a973ec324a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:47.474645 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ec376-af63-4506-a366-2a973ec324a6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:47.475120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ec376-af63-4506-a366-2a973ec324a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:47.475602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ec376-af63-4506-a366-2a973ec324a6 None admin] PATH_INFO: `/v3/users/33ca46aa10824dbdb4be243951ab25d7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:47.477001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ec376-af63-4506-a366-2a973ec324a6 None admin] RBAC: Authorizing `identity:get_user(user_id=33ca46aa10824dbdb4be243951ab25d7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:47.478711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ec376-af63-4506-a366-2a973ec324a6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:47.480574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 92/177] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:47 2022] GET /identity/v3/users/33ca46aa10824dbdb4be243951ab25d7 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:47.481569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ec376-af63-4506-a366-2a973ec324a6 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:47.535633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 86/178] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:47.543529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d9bc8-692d-4bb8-8594-14b699201a28 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:47.582303 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:47.586727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ec376-af63-4506-a366-2a973ec324a6 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:47.622263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1255ed3-16ab-4f50-ab3f-e96f10d5230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:47.623712 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1255ed3-16ab-4f50-ab3f-e96f10d5230c None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:47.624221 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1255ed3-16ab-4f50-ab3f-e96f10d5230c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:47.624791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1255ed3-16ab-4f50-ab3f-e96f10d5230c None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8/users/bcefbc23b26842bf9632da350aba0415/roles/5c5cdc6f15a846a0829e831d6a8949d4` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:47.627271 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1255ed3-16ab-4f50-ab3f-e96f10d5230c None admin] RBAC: Authorizing `identity:create_grant(project_id=f24f46abed0346909dcf67babae2c4d8, user_id=bcefbc23b26842bf9632da350aba0415, role_id=5c5cdc6f15a846a0829e831d6a8949d4)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:47.629317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1255ed3-16ab-4f50-ab3f-e96f10d5230c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:47.645756 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 93/179] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:03:47 2022] PUT /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8/users/bcefbc23b26842bf9632da350aba0415/roles/5c5cdc6f15a846a0829e831d6a8949d4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:03:47.647255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1255ed3-16ab-4f50-ab3f-e96f10d5230c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:47.650541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:47.677051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d9bc8-692d-4bb8-8594-14b699201a28 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:47.719000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3e75e-eee1-4028-962a-6b55abfd966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:47.719686 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e75e-eee1-4028-962a-6b55abfd966c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:47.719952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e75e-eee1-4028-962a-6b55abfd966c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:47.720275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e75e-eee1-4028-962a-6b55abfd966c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:47.771960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1255ed3-16ab-4f50-ab3f-e96f10d5230c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:47.800859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3e75e-eee1-4028-962a-6b55abfd966c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:47.802381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3e75e-eee1-4028-962a-6b55abfd966c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:47.811833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd5ef8-8ca8-45be-9069-600e7fafa6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:47.813218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5ef8-8ca8-45be-9069-600e7fafa6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:47.813714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5ef8-8ca8-45be-9069-600e7fafa6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:47.814343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5ef8-8ca8-45be-9069-600e7fafa6f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:47.827021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:47.828298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd5ef8-8ca8-45be-9069-600e7fafa6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-6edd5ef8-8ca8-45be-9069-600e7fafa6f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:47.838195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:47.839223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:47.840007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:47.842623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 94/180] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:03:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:47.855494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd5ef8-8ca8-45be-9069-600e7fafa6f0 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:47.931333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 87/181] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:47.950118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3e75e-eee1-4028-962a-6b55abfd966c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:47.979727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:48.041394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd5ef8-8ca8-45be-9069-600e7fafa6f0 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:48.090690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3e75e-eee1-4028-962a-6b55abfd966c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:48.112445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a1923-bd40-4785-8acb-90ac37ff0e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:48.113141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a1923-bd40-4785-8acb-90ac37ff0e02 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.113416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a1923-bd40-4785-8acb-90ac37ff0e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.113684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a1923-bd40-4785-8acb-90ac37ff0e02 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.114466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a1923-bd40-4785-8acb-90ac37ff0e02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:48.114773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a1923-bd40-4785-8acb-90ac37ff0e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:48.117371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a1923-bd40-4785-8acb-90ac37ff0e02 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:48.130162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:48.135913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 95/182] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:48.143505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a1923-bd40-4785-8acb-90ac37ff0e02 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:48.178596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9510b-2253-4c78-bb40-7f95aa2d002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:48.179554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9510b-2253-4c78-bb40-7f95aa2d002f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.179820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9510b-2253-4c78-bb40-7f95aa2d002f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.180090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9510b-2253-4c78-bb40-7f95aa2d002f None admin] PATH_INFO: `/v3/projects/be6d19585b074287a35ca07963807037` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.181780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9510b-2253-4c78-bb40-7f95aa2d002f None admin] RBAC: Authorizing `identity:get_project(project_id=be6d19585b074287a35ca07963807037)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:48.183397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9510b-2253-4c78-bb40-7f95aa2d002f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:48.185186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 88/183] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:47 2022] GET /identity/v3/projects/be6d19585b074287a35ca07963807037 => generated 312 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:48.186394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24180d-7089-4763-be37-e53f1db01a82 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.186675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24180d-7089-4763-be37-e53f1db01a82 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.187952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24180d-7089-4763-be37-e53f1db01a82 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.194741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 89/184] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:48.195624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24180d-7089-4763-be37-e53f1db01a82 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:48.287836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a1923-bd40-4785-8acb-90ac37ff0e02 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:48.321864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:48.325542 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24180d-7089-4763-be37-e53f1db01a82 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:48.335675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dde08-205d-4add-91fa-46817804f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:48.336593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dde08-205d-4add-91fa-46817804f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.336874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dde08-205d-4add-91fa-46817804f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.337143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dde08-205d-4add-91fa-46817804f2e0 None admin] PATH_INFO: `/v3/users/268089ef33404a8ab03d66d1e0e4cc78` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.351958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dde08-205d-4add-91fa-46817804f2e0 None admin] RBAC: Authorizing `identity:get_user(user_id=268089ef33404a8ab03d66d1e0e4cc78)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:48.353437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dde08-205d-4add-91fa-46817804f2e0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:48.355243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 96/185] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:48 2022] GET /identity/v3/users/268089ef33404a8ab03d66d1e0e4cc78 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:48.356563 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1269-23c5-4256-a3b7-a74ff78b9f98 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.356842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1269-23c5-4256-a3b7-a74ff78b9f98 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.357115 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1269-23c5-4256-a3b7-a74ff78b9f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.374536 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-fe5b1269-23c5-4256-a3b7-a74ff78b9f98 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:48.375738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5f652-0492-43e4-8e19-90b0abe4589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:48.375933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fe5b1269-23c5-4256-a3b7-a74ff78b9f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:48.377173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f652-0492-43e4-8e19-90b0abe4589a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.377734 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f652-0492-43e4-8e19-90b0abe4589a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.378440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f652-0492-43e4-8e19-90b0abe4589a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.380183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5f652-0492-43e4-8e19-90b0abe4589a None admin] RBAC: Adding query filter params (role.id=86e9a6602f6945d7b87811b8708df6b7, scope.project.id=be6d19585b074287a35ca07963807037, user.id=33ca46aa10824dbdb4be243951ab25d7) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:48.380894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5f652-0492-43e4-8e19-90b0abe4589a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:48.383650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5f652-0492-43e4-8e19-90b0abe4589a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:48.392050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 90/186] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:48 2022] GET /identity/v3/role_assignments?user.id=33ca46aa10824dbdb4be243951ab25d7&scope.project.id=be6d19585b074287a35ca07963807037&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:48.393763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a4054-7d60-4cc2-a010-a270a2c64817 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.394188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a4054-7d60-4cc2-a010-a270a2c64817 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.394636 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a4054-7d60-4cc2-a010-a270a2c64817 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.396040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 91/187] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:48.396891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a4054-7d60-4cc2-a010-a270a2c64817 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:48.478201 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:48.487934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 97/188] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:48.489842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38ae68-f7b5-4539-ab66-b87b7222fc43 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.490389 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38ae68-f7b5-4539-ab66-b87b7222fc43 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.490839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38ae68-f7b5-4539-ab66-b87b7222fc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.515435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-bc38ae68-f7b5-4539-ab66-b87b7222fc43 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:48.517003 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bc38ae68-f7b5-4539-ab66-b87b7222fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:48.541664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a4054-7d60-4cc2-a010-a270a2c64817 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:48.590540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd4aea-99d1-4f54-a732-8cb1bd20c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:48.591500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd4aea-99d1-4f54-a732-8cb1bd20c410 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.591970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd4aea-99d1-4f54-a732-8cb1bd20c410 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.592408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd4aea-99d1-4f54-a732-8cb1bd20c410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.621254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 98/189] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:48.621931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38ae68-f7b5-4539-ab66-b87b7222fc43 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:48.680304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:48.681650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd4aea-99d1-4f54-a732-8cb1bd20c410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:48.683627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd4aea-99d1-4f54-a732-8cb1bd20c410 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:48.755282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38ae68-f7b5-4539-ab66-b87b7222fc43 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:48.758275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:48.795988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244fd5d-cc23-499d-a0c6-0dbe64749906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:48.797520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244fd5d-cc23-499d-a0c6-0dbe64749906 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.798057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244fd5d-cc23-499d-a0c6-0dbe64749906 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.798534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244fd5d-cc23-499d-a0c6-0dbe64749906 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.800087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244fd5d-cc23-499d-a0c6-0dbe64749906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:48.802098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244fd5d-cc23-499d-a0c6-0dbe64749906 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:48.803799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 99/190] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:48.804760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244fd5d-cc23-499d-a0c6-0dbe64749906 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:48.816377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 92/191] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:48.817752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd4aea-99d1-4f54-a732-8cb1bd20c410 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:48.928473 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244fd5d-cc23-499d-a0c6-0dbe64749906 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:48.931322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd4aea-99d1-4f54-a732-8cb1bd20c410 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:48.941701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:48.968989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88472b6-20a8-4890-b620-185978f58d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:48.969842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88472b6-20a8-4890-b620-185978f58d3d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.970166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88472b6-20a8-4890-b620-185978f58d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.970594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88472b6-20a8-4890-b620-185978f58d3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.971760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb474-6423-4718-a2fb-1bf0eb761c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:48.972441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb474-6423-4718-a2fb-1bf0eb761c6e None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:48.972731 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb474-6423-4718-a2fb-1bf0eb761c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:48.972998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb474-6423-4718-a2fb-1bf0eb761c6e None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:48.973720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eb474-6423-4718-a2fb-1bf0eb761c6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:48.975197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eb474-6423-4718-a2fb-1bf0eb761c6e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:48.983868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88472b6-20a8-4890-b620-185978f58d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-c88472b6-20a8-4890-b620-185978f58d3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:48.993762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:49.003277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 100/192] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:03:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:49.004572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88472b6-20a8-4890-b620-185978f58d3d None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:49.013515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 93/193] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:03:48 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:49.014590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb474-6423-4718-a2fb-1bf0eb761c6e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:49.033392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:49.151116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88472b6-20a8-4890-b620-185978f58d3d None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:49.184588 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb474-6423-4718-a2fb-1bf0eb761c6e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:49.190041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03577748-e2e2-4361-9172-c92108734887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:49.191093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03577748-e2e2-4361-9172-c92108734887 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:49.191476 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03577748-e2e2-4361-9172-c92108734887 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:49.191847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03577748-e2e2-4361-9172-c92108734887 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:49.193947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03577748-e2e2-4361-9172-c92108734887 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:49.195989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03577748-e2e2-4361-9172-c92108734887 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:49.198265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 101/194] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:48 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:49.204256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03577748-e2e2-4361-9172-c92108734887 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:49.229782 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bd896-7977-4407-a673-f5f738d3757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:49.230892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bd896-7977-4407-a673-f5f738d3757d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:49.231361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bd896-7977-4407-a673-f5f738d3757d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:49.232969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bd896-7977-4407-a673-f5f738d3757d None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:49.232969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bd896-7977-4407-a673-f5f738d3757d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:49.232969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bd896-7977-4407-a673-f5f738d3757d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:49.236019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bd896-7977-4407-a673-f5f738d3757d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:49.248228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 94/195] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:03:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:49.254068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bd896-7977-4407-a673-f5f738d3757d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:49.265956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:49.339573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03577748-e2e2-4361-9172-c92108734887 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:49.351440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:49.387094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0f0a-bb38-4656-b652-1f6cb87407e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:49.387765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0f0a-bb38-4656-b652-1f6cb87407e0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:49.388042 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0f0a-bb38-4656-b652-1f6cb87407e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:49.388307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0f0a-bb38-4656-b652-1f6cb87407e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:49.389144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f0f0a-bb38-4656-b652-1f6cb87407e0 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=fa972b04f73040768b4e81de2c1b8d95, user.id=268089ef33404a8ab03d66d1e0e4cc78) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:49.389458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f0f0a-bb38-4656-b652-1f6cb87407e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:49.390994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f0f0a-bb38-4656-b652-1f6cb87407e0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:49.393316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bd896-7977-4407-a673-f5f738d3757d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:49.396928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 102/196] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:49 2022] GET /identity/v3/role_assignments?user.id=268089ef33404a8ab03d66d1e0e4cc78&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:49.436044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1010a-df53-4868-9588-5ddfb6a05803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:49.437275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1010a-df53-4868-9588-5ddfb6a05803 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:49.437741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1010a-df53-4868-9588-5ddfb6a05803 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:49.438203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1010a-df53-4868-9588-5ddfb6a05803 None admin] PATH_INFO: `/v3/users/268089ef33404a8ab03d66d1e0e4cc78` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:49.439860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1010a-df53-4868-9588-5ddfb6a05803 None admin] RBAC: Authorizing `identity:get_user(user_id=268089ef33404a8ab03d66d1e0e4cc78)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:49.441691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1010a-df53-4868-9588-5ddfb6a05803 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:49.443952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 95/197] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:49 2022] GET /identity/v3/users/268089ef33404a8ab03d66d1e0e4cc78 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:49.449952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0f0a-bb38-4656-b652-1f6cb87407e0 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:49.571347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0f0a-bb38-4656-b652-1f6cb87407e0 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:49.573372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:49.610140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8a17f-ce90-4013-9ee9-175634a89e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:49.610853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8a17f-ce90-4013-9ee9-175634a89e52 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:49.611169 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8a17f-ce90-4013-9ee9-175634a89e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:49.611432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8a17f-ce90-4013-9ee9-175634a89e52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:49.684694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8a17f-ce90-4013-9ee9-175634a89e52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:49.686319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8a17f-ce90-4013-9ee9-175634a89e52 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:49.791355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 103/198] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:49.799995 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1010a-df53-4868-9588-5ddfb6a05803 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:49.937198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1010a-df53-4868-9588-5ddfb6a05803 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:49.987465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d63c0-5a54-4c4b-aa03-510f313b8adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:49.988355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d63c0-5a54-4c4b-aa03-510f313b8adb None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:49.988632 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d63c0-5a54-4c4b-aa03-510f313b8adb None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:49.988903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d63c0-5a54-4c4b-aa03-510f313b8adb None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:49.990100 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d63c0-5a54-4c4b-aa03-510f313b8adb None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:49.991955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d63c0-5a54-4c4b-aa03-510f313b8adb None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:49.993682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 96/199] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:49 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:49.998199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbf0cc-5a1c-4179-a8dc-6fcffba11e6e None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:49.998709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbf0cc-5a1c-4179-a8dc-6fcffba11e6e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:49.998781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbf0cc-5a1c-4179-a8dc-6fcffba11e6e None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:50.000267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 104/200] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:50.001038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d63c0-5a54-4c4b-aa03-510f313b8adb None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:50.005765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8404b-ed80-478a-ad2d-ed172e78d377 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:50.006047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8404b-ed80-478a-ad2d-ed172e78d377 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:50.006333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8404b-ed80-478a-ad2d-ed172e78d377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:50.014891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:50.030646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:50.036509 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7be8404b-ed80-478a-ad2d-ed172e78d377 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:50.037966 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7be8404b-ed80-478a-ad2d-ed172e78d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:50.173390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 105/201] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:50.196912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8404b-ed80-478a-ad2d-ed172e78d377 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:50.202446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d63c0-5a54-4c4b-aa03-510f313b8adb None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:50.271110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb671196-b858-42b4-95fa-89cc13b33897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:50.271792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb671196-b858-42b4-95fa-89cc13b33897 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:50.272071 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb671196-b858-42b4-95fa-89cc13b33897 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:50.272344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb671196-b858-42b4-95fa-89cc13b33897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:50.273187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb671196-b858-42b4-95fa-89cc13b33897 None admin] RBAC: Adding query filter params (role.id=66ac9c3671cb46b6ae847fdbc68015b3, scope.project.id=fa972b04f73040768b4e81de2c1b8d95, user.id=268089ef33404a8ab03d66d1e0e4cc78) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:50.273495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb671196-b858-42b4-95fa-89cc13b33897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:50.274979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb671196-b858-42b4-95fa-89cc13b33897 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:50.282310 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 97/202] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:50 2022] GET /identity/v3/role_assignments?user.id=268089ef33404a8ab03d66d1e0e4cc78&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=66ac9c3671cb46b6ae847fdbc68015b3 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:50.322489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8404b-ed80-478a-ad2d-ed172e78d377 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:50.368973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:50.376623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf638e9-b2db-483d-99c5-5a524b7a6b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:50.378422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf638e9-b2db-483d-99c5-5a524b7a6b46 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:50.378706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf638e9-b2db-483d-99c5-5a524b7a6b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:50.378978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf638e9-b2db-483d-99c5-5a524b7a6b46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:50.395478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf638e9-b2db-483d-99c5-5a524b7a6b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-bcf638e9-b2db-483d-99c5-5a524b7a6b46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:50.403342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:50.404252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:50.405354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 106/203] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:50.410781 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb671196-b858-42b4-95fa-89cc13b33897 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:50.515365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:50.560348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb671196-b858-42b4-95fa-89cc13b33897 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:50.596395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68443b3a-e427-419b-a40b-71d0a20de341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:50.597426 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68443b3a-e427-419b-a40b-71d0a20de341 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:50.597899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68443b3a-e427-419b-a40b-71d0a20de341 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:50.598395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68443b3a-e427-419b-a40b-71d0a20de341 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:50.599380 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68443b3a-e427-419b-a40b-71d0a20de341 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:50.599879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68443b3a-e427-419b-a40b-71d0a20de341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:50.601521 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68443b3a-e427-419b-a40b-71d0a20de341 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:50.611849 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 98/204] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:50.618530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf638e9-b2db-483d-99c5-5a524b7a6b46 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:50.738549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf638e9-b2db-483d-99c5-5a524b7a6b46 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:50.792410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc794-5ea9-4c22-b464-9cce9e572b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:50.793672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc794-5ea9-4c22-b464-9cce9e572b8e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:50.794144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc794-5ea9-4c22-b464-9cce9e572b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:50.794633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc794-5ea9-4c22-b464-9cce9e572b8e None admin] PATH_INFO: `/v3/users/bcefbc23b26842bf9632da350aba0415` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:50.796070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dc794-5ea9-4c22-b464-9cce9e572b8e None admin] RBAC: Authorizing `identity:get_user(user_id=bcefbc23b26842bf9632da350aba0415)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:50.797730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dc794-5ea9-4c22-b464-9cce9e572b8e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:50.800005 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 107/205] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:50 2022] GET /identity/v3/users/bcefbc23b26842bf9632da350aba0415 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:50.805633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68443b3a-e427-419b-a40b-71d0a20de341 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:50.911605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68443b3a-e427-419b-a40b-71d0a20de341 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:50.945864 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:50.952735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ce42-0941-45a6-8794-026c42fdaab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:50.953406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ce42-0941-45a6-8794-026c42fdaab6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:50.953684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ce42-0941-45a6-8794-026c42fdaab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:50.953959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ce42-0941-45a6-8794-026c42fdaab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:51.025735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885ce42-0941-45a6-8794-026c42fdaab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:51.027309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885ce42-0941-45a6-8794-026c42fdaab6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:51.130206 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 99/206] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:51.135753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc794-5ea9-4c22-b464-9cce9e572b8e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:51.196058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:51.237761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc794-5ea9-4c22-b464-9cce9e572b8e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:51.280833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a398d-c084-4bb9-8b48-c730ff0f534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:51.281725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a398d-c084-4bb9-8b48-c730ff0f534f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:51.282005 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a398d-c084-4bb9-8b48-c730ff0f534f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:51.282283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a398d-c084-4bb9-8b48-c730ff0f534f None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:51.283737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a398d-c084-4bb9-8b48-c730ff0f534f None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:51.285192 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a398d-c084-4bb9-8b48-c730ff0f534f None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:51.287273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 108/207] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:51 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:51.293058 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ce42-0941-45a6-8794-026c42fdaab6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:51.324404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:51.401134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ce42-0941-45a6-8794-026c42fdaab6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:51.436560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bc5f6-518c-4beb-8c11-084e146e7a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:51.437231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bc5f6-518c-4beb-8c11-084e146e7a7d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:51.437512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bc5f6-518c-4beb-8c11-084e146e7a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:51.437785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bc5f6-518c-4beb-8c11-084e146e7a7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:51.438662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bc5f6-518c-4beb-8c11-084e146e7a7d None admin] RBAC: Adding query filter params (role.id=5c5cdc6f15a846a0829e831d6a8949d4, scope.project.id=f24f46abed0346909dcf67babae2c4d8, user.id=bcefbc23b26842bf9632da350aba0415) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:51.438975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bc5f6-518c-4beb-8c11-084e146e7a7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:51.440503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bc5f6-518c-4beb-8c11-084e146e7a7d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:51.446830 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 100/208] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:51 2022] GET /identity/v3/role_assignments?user.id=bcefbc23b26842bf9632da350aba0415&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=5c5cdc6f15a846a0829e831d6a8949d4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:51.836669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56da30-7c4b-4d0d-9b86-17d661f9fc00 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:51.837380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56da30-7c4b-4d0d-9b86-17d661f9fc00 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:51.837870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56da30-7c4b-4d0d-9b86-17d661f9fc00 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:51.839489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 109/209] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:51.845033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41edf66-fe9c-475c-b69e-63f061b1fb7c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:51.845675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41edf66-fe9c-475c-b69e-63f061b1fb7c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:51.846797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41edf66-fe9c-475c-b69e-63f061b1fb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:51.868125 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c41edf66-fe9c-475c-b69e-63f061b1fb7c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:51.869663 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c41edf66-fe9c-475c-b69e-63f061b1fb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:51.888950 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71b7c-660d-4f74-b19e-adc7c9667bde None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:51.889561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71b7c-660d-4f74-b19e-adc7c9667bde None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:51.890059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71b7c-660d-4f74-b19e-adc7c9667bde None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:51.891770 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 110/210] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:03:51.898583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d48e-9259-4175-acaf-82fd9ee8fdfd None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:51.899145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d48e-9259-4175-acaf-82fd9ee8fdfd None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:51.899621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d48e-9259-4175-acaf-82fd9ee8fdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:51.920287 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-4898d48e-9259-4175-acaf-82fd9ee8fdfd None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:51.921834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-4898d48e-9259-4175-acaf-82fd9ee8fdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:51.962271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 101/211] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:51.987056 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41edf66-fe9c-475c-b69e-63f061b1fb7c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:52.018315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 111/212] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:52.027844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:52.044996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898d48e-9259-4175-acaf-82fd9ee8fdfd None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:52.108027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:52.125900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41edf66-fe9c-475c-b69e-63f061b1fb7c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:52.154342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898d48e-9259-4175-acaf-82fd9ee8fdfd None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:52.168809 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409233b-150d-452f-86f3-78aca241e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:52.169642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409233b-150d-452f-86f3-78aca241e086 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:52.169918 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409233b-150d-452f-86f3-78aca241e086 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:52.170413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409233b-150d-452f-86f3-78aca241e086 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:52.182471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409233b-150d-452f-86f3-78aca241e086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-1409233b-150d-452f-86f3-78aca241e086 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:52.190579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:52.191474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:52.192668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:52.193590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afa0b7-454c-4b38-862c-503df7537216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:52.193590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afa0b7-454c-4b38-862c-503df7537216 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:52.193590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afa0b7-454c-4b38-862c-503df7537216 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:52.193778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 102/213] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:03:52.193850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afa0b7-454c-4b38-862c-503df7537216 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:52.193850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afa0b7-454c-4b38-862c-503df7537216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:52.195413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afa0b7-454c-4b38-862c-503df7537216 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:52.195774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d6edc-9474-4004-a77d-49ba328530df None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:52.196218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d6edc-9474-4004-a77d-49ba328530df None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:52.196756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d6edc-9474-4004-a77d-49ba328530df None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:52.197415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 112/214] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:52.198033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afa0b7-454c-4b38-862c-503df7537216 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:52.202666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 103/215] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:52.203586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d6edc-9474-4004-a77d-49ba328530df None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:52.305901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:52.308425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afa0b7-454c-4b38-862c-503df7537216 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:52.325184 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d6edc-9474-4004-a77d-49ba328530df None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:52.335377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:52.346757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da95029-4976-4d7f-8522-d97ccfbbbe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:52.347471 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95029-4976-4d7f-8522-d97ccfbbbe67 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:52.347751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95029-4976-4d7f-8522-d97ccfbbbe67 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:52.348018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95029-4976-4d7f-8522-d97ccfbbbe67 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:52.349221 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da95029-4976-4d7f-8522-d97ccfbbbe67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:52.349632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da95029-4976-4d7f-8522-d97ccfbbbe67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:52.350947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da95029-4976-4d7f-8522-d97ccfbbbe67 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:52.363720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 113/216] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:52.363720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003511-f4e9-4636-a8c1-ad3f7f9729e0 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:52.363720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003511-f4e9-4636-a8c1-ad3f7f9729e0 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:52.363720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003511-f4e9-4636-a8c1-ad3f7f9729e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:52.368400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82eade-3703-4809-8a49-55ae27913006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:52.369352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82eade-3703-4809-8a49-55ae27913006 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:52.369644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82eade-3703-4809-8a49-55ae27913006 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:52.369916 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82eade-3703-4809-8a49-55ae27913006 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:52.370666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82eade-3703-4809-8a49-55ae27913006 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:52.372178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82eade-3703-4809-8a49-55ae27913006 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:52.379103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-ae003511-f4e9-4636-a8c1-ad3f7f9729e0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:52.380272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ae003511-f4e9-4636-a8c1-ad3f7f9729e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:52.394771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 104/217] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:03:52 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:52.395605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82eade-3703-4809-8a49-55ae27913006 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:52.470898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 114/218] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:52.499647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae003511-f4e9-4636-a8c1-ad3f7f9729e0 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:52.553717 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82eade-3703-4809-8a49-55ae27913006 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:52.590975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77565b-8603-46c7-a5d1-662312511bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:52.591889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77565b-8603-46c7-a5d1-662312511bfa None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:52.592168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77565b-8603-46c7-a5d1-662312511bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:52.592460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77565b-8603-46c7-a5d1-662312511bfa None admin] PATH_INFO: `/v3/users/c96fe658a5e1449993a340c063ce7125` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:52.604539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:52.607822 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77565b-8603-46c7-a5d1-662312511bfa None admin] RBAC: Authorizing `identity:get_user(user_id=c96fe658a5e1449993a340c063ce7125)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:52.609358 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77565b-8603-46c7-a5d1-662312511bfa None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:52.612311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 105/219] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:52 2022] GET /identity/v3/users/c96fe658a5e1449993a340c063ce7125 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:52.619292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77565b-8603-46c7-a5d1-662312511bfa None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:52.620162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae003511-f4e9-4636-a8c1-ad3f7f9729e0 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:52.646226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:52.676149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888eeded-2c42-4916-b923-1ad902193724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:52.676981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eeded-2c42-4916-b923-1ad902193724 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:52.677264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eeded-2c42-4916-b923-1ad902193724 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:52.677537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eeded-2c42-4916-b923-1ad902193724 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:52.691074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888eeded-2c42-4916-b923-1ad902193724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-888eeded-2c42-4916-b923-1ad902193724 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:52.699546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:52.700474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:52.701263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 115/220] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:03:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:03:52.710701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888eeded-2c42-4916-b923-1ad902193724 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:52.752542 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77565b-8603-46c7-a5d1-662312511bfa None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:52.802047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331be00-4142-4194-a7f5-12e0b42f3fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:52.802766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331be00-4142-4194-a7f5-12e0b42f3fcd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:52.803041 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331be00-4142-4194-a7f5-12e0b42f3fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:52.803308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331be00-4142-4194-a7f5-12e0b42f3fcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:52.837327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888eeded-2c42-4916-b923-1ad902193724 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:52.878953 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:52.881025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910a795-f764-4612-9062-0af8dd2129f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:52.881781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910a795-f764-4612-9062-0af8dd2129f2 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:52.882131 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910a795-f764-4612-9062-0af8dd2129f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:52.882500 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910a795-f764-4612-9062-0af8dd2129f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:52.882687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331be00-4142-4194-a7f5-12e0b42f3fcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:52.883404 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910a795-f764-4612-9062-0af8dd2129f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:52.883775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910a795-f764-4612-9062-0af8dd2129f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:52.884780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331be00-4142-4194-a7f5-12e0b42f3fcd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:52.885217 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910a795-f764-4612-9062-0af8dd2129f2 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:52.896097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 116/221] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:52.901347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73395a7e-9096-459f-ac29-8bcae10e9df5 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:52.901347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73395a7e-9096-459f-ac29-8bcae10e9df5 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:52.901347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73395a7e-9096-459f-ac29-8bcae10e9df5 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:52.901347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 117/222] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:52.903260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73395a7e-9096-459f-ac29-8bcae10e9df5 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:52.952427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:53.017681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73395a7e-9096-459f-ac29-8bcae10e9df5 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:53.023448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 106/223] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 03:03:53.024819 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d553b0-c130-4fe0-94ec-10bad12faf06 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:53.025109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d553b0-c130-4fe0-94ec-10bad12faf06 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:53.025383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d553b0-c130-4fe0-94ec-10bad12faf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:53.046913 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-62d553b0-c130-4fe0-94ec-10bad12faf06 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:53.048391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-62d553b0-c130-4fe0-94ec-10bad12faf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:53.057995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e14710-ee48-4b01-916e-e3563faa425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:53.059201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14710-ee48-4b01-916e-e3563faa425e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:53.059681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14710-ee48-4b01-916e-e3563faa425e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:53.060196 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14710-ee48-4b01-916e-e3563faa425e None admin] PATH_INFO: `/v3/users/268089ef33404a8ab03d66d1e0e4cc78` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:53.061665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e14710-ee48-4b01-916e-e3563faa425e None admin] RBAC: Authorizing `identity:get_user(user_id=268089ef33404a8ab03d66d1e0e4cc78)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:53.063485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e14710-ee48-4b01-916e-e3563faa425e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:53.070378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 118/224] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:52 2022] GET /identity/v3/users/268089ef33404a8ab03d66d1e0e4cc78 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:53.071636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e14710-ee48-4b01-916e-e3563faa425e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:53.138477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 107/225] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:53.139531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d553b0-c130-4fe0-94ec-10bad12faf06 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:53.187764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:53.195805 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e14710-ee48-4b01-916e-e3563faa425e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:53.206117 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:53.234094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712a54f-0a55-4c0e-a721-3e381acaa182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:53.235155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712a54f-0a55-4c0e-a721-3e381acaa182 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:53.235489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712a54f-0a55-4c0e-a721-3e381acaa182 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:53.235767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712a54f-0a55-4c0e-a721-3e381acaa182 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:53.237250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712a54f-0a55-4c0e-a721-3e381acaa182 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:53.238762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712a54f-0a55-4c0e-a721-3e381acaa182 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:53.241479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 119/226] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:53 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:53.242248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712a54f-0a55-4c0e-a721-3e381acaa182 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:53.283371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d553b0-c130-4fe0-94ec-10bad12faf06 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:53.328750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003b2e9-43ca-4a9f-a06d-8cfe52eb70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:53.330176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b2e9-43ca-4a9f-a06d-8cfe52eb70c9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:53.331105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b2e9-43ca-4a9f-a06d-8cfe52eb70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:53.331684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b2e9-43ca-4a9f-a06d-8cfe52eb70c9 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:53.333364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003b2e9-43ca-4a9f-a06d-8cfe52eb70c9 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:53.335404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003b2e9-43ca-4a9f-a06d-8cfe52eb70c9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:53.337799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 108/227] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:53 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:53.338732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003b2e9-43ca-4a9f-a06d-8cfe52eb70c9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:53.356812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712a54f-0a55-4c0e-a721-3e381acaa182 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:53.397151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d78cf-d115-48e8-81fd-2fe7df709ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:53.398089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d78cf-d115-48e8-81fd-2fe7df709ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:53.398468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d78cf-d115-48e8-81fd-2fe7df709ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:53.399152 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d78cf-d115-48e8-81fd-2fe7df709ce3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:53.410172 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d78cf-d115-48e8-81fd-2fe7df709ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-917d78cf-d115-48e8-81fd-2fe7df709ce3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:53.419022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:53.420113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:53.421084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:53.421816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 120/228] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:03:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:53.426328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d78cf-d115-48e8-81fd-2fe7df709ce3 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:53.459663 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:53.461566 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:53.465629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003b2e9-43ca-4a9f-a06d-8cfe52eb70c9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:53.504155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afedd6f-bdf8-4711-96ec-1958334f9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:53.505075 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afedd6f-bdf8-4711-96ec-1958334f9105 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:53.505556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afedd6f-bdf8-4711-96ec-1958334f9105 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:53.505964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afedd6f-bdf8-4711-96ec-1958334f9105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:53.506979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afedd6f-bdf8-4711-96ec-1958334f9105 None admin] RBAC: Adding query filter params (role.id=86e9a6602f6945d7b87811b8708df6b7, scope.project.id=fa972b04f73040768b4e81de2c1b8d95, user.id=c96fe658a5e1449993a340c063ce7125) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:53.507504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afedd6f-bdf8-4711-96ec-1958334f9105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:53.509269 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afedd6f-bdf8-4711-96ec-1958334f9105 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:53.515644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 109/229] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:53 2022] GET /identity/v3/role_assignments?user.id=c96fe658a5e1449993a340c063ce7125&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:53.516562 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afedd6f-bdf8-4711-96ec-1958334f9105 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:53.532873 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d78cf-d115-48e8-81fd-2fe7df709ce3 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:53.571778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2bc8b-1751-493b-b225-d5acaa941c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:53.572710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2bc8b-1751-493b-b225-d5acaa941c75 None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:53.573021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2bc8b-1751-493b-b225-d5acaa941c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:53.573402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2bc8b-1751-493b-b225-d5acaa941c75 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95/users/268089ef33404a8ab03d66d1e0e4cc78/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:53.575673 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2bc8b-1751-493b-b225-d5acaa941c75 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa972b04f73040768b4e81de2c1b8d95, user_id=268089ef33404a8ab03d66d1e0e4cc78, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:53.577158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2bc8b-1751-493b-b225-d5acaa941c75 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:53.594213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 121/230] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:03:53 2022] PUT /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95/users/268089ef33404a8ab03d66d1e0e4cc78/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:03:53.635540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afedd6f-bdf8-4711-96ec-1958334f9105 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:53.673650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739382c-85a8-4650-a141-2adcf0109a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:53.674751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739382c-85a8-4650-a141-2adcf0109a28 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:53.675251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739382c-85a8-4650-a141-2adcf0109a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:53.675727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739382c-85a8-4650-a141-2adcf0109a28 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:53.676695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739382c-85a8-4650-a141-2adcf0109a28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:53.677204 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739382c-85a8-4650-a141-2adcf0109a28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:53.678898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739382c-85a8-4650-a141-2adcf0109a28 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:53.691894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 110/231] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:03:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:53.702986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2bc8b-1751-493b-b225-d5acaa941c75 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:53.861853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2bc8b-1751-493b-b225-d5acaa941c75 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:53.870981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:53.904162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d2e52-1bdf-401b-b628-4b5e362b766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:53.905056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d2e52-1bdf-401b-b628-4b5e362b766a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:53.905333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d2e52-1bdf-401b-b628-4b5e362b766a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:53.905592 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d2e52-1bdf-401b-b628-4b5e362b766a None admin] PATH_INFO: `/v3/users/268089ef33404a8ab03d66d1e0e4cc78` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:53.906815 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d2e52-1bdf-401b-b628-4b5e362b766a None admin] RBAC: Authorizing `identity:get_user(user_id=268089ef33404a8ab03d66d1e0e4cc78)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:53.908878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d2e52-1bdf-401b-b628-4b5e362b766a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:53.910948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 122/232] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:53 2022] GET /identity/v3/users/268089ef33404a8ab03d66d1e0e4cc78 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:53.916210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739382c-85a8-4650-a141-2adcf0109a28 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:53.949368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:54.053263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739382c-85a8-4650-a141-2adcf0109a28 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:54.100615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb03c1-b4e5-40f4-9918-71d40e7a5050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:54.101531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb03c1-b4e5-40f4-9918-71d40e7a5050 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:54.101861 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb03c1-b4e5-40f4-9918-71d40e7a5050 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:54.102145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb03c1-b4e5-40f4-9918-71d40e7a5050 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:54.103396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb03c1-b4e5-40f4-9918-71d40e7a5050 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:54.104852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb03c1-b4e5-40f4-9918-71d40e7a5050 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:54.106930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 111/233] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:53 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:54.112918 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d2e52-1bdf-401b-b628-4b5e362b766a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:54.229363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d2e52-1bdf-401b-b628-4b5e362b766a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:54.264496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a597327-b8b1-4008-9884-fb6538c7de4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:54.265421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597327-b8b1-4008-9884-fb6538c7de4b None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:54.265703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597327-b8b1-4008-9884-fb6538c7de4b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:54.265978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597327-b8b1-4008-9884-fb6538c7de4b None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95/users/268089ef33404a8ab03d66d1e0e4cc78/roles/66ac9c3671cb46b6ae847fdbc68015b3` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:54.268313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a597327-b8b1-4008-9884-fb6538c7de4b None admin] RBAC: Authorizing `identity:create_grant(project_id=fa972b04f73040768b4e81de2c1b8d95, user_id=268089ef33404a8ab03d66d1e0e4cc78, role_id=66ac9c3671cb46b6ae847fdbc68015b3)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:54.269900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a597327-b8b1-4008-9884-fb6538c7de4b None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:54.286505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 123/234] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:03:54 2022] PUT /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95/users/268089ef33404a8ab03d66d1e0e4cc78/roles/66ac9c3671cb46b6ae847fdbc68015b3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:03:54.888335 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4438a7-b245-4ee7-ae39-6e8a68932a84 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:54.889054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4438a7-b245-4ee7-ae39-6e8a68932a84 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:54.889529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4438a7-b245-4ee7-ae39-6e8a68932a84 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:54.891153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 112/235] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:54.897025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f367a-6f36-4a8d-a3ff-fb4d9b37c01d None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:54.897314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f367a-6f36-4a8d-a3ff-fb4d9b37c01d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:54.897595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f367a-6f36-4a8d-a3ff-fb4d9b37c01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:54.918708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-dd6f367a-6f36-4a8d-a3ff-fb4d9b37c01d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:54.919943 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-dd6f367a-6f36-4a8d-a3ff-fb4d9b37c01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:54.943274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:54.996134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adc338-5392-4598-ac2f-55f5cd6fbbd0 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:54.996467 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adc338-5392-4598-ac2f-55f5cd6fbbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:54.996689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adc338-5392-4598-ac2f-55f5cd6fbbd0 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:55.002013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 113/236] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:55.003284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f47953-1b86-485a-a170-cb4d4e5a819e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:55.003570 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f47953-1b86-485a-a170-cb4d4e5a819e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:55.003847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f47953-1b86-485a-a170-cb4d4e5a819e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:55.008488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 124/237] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:55.021468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-85f47953-1b86-485a-a170-cb4d4e5a819e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:55.022822 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-85f47953-1b86-485a-a170-cb4d4e5a819e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:55.039998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f367a-6f36-4a8d-a3ff-fb4d9b37c01d None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:55.118934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 114/238] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:55.145316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f47953-1b86-485a-a170-cb4d4e5a819e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:55.184243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:55.223435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f367a-6f36-4a8d-a3ff-fb4d9b37c01d None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:55.266433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53734c12-89e8-4227-a499-b76fc700e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:55.266433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53734c12-89e8-4227-a499-b76fc700e861 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:55.266433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53734c12-89e8-4227-a499-b76fc700e861 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:55.266433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53734c12-89e8-4227-a499-b76fc700e861 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:55.267325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53734c12-89e8-4227-a499-b76fc700e861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:55.267325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53734c12-89e8-4227-a499-b76fc700e861 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:55.267325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 125/239] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:55.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53734c12-89e8-4227-a499-b76fc700e861 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:55.303821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:55.306112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f47953-1b86-485a-a170-cb4d4e5a819e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:55.368250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7321375-2254-4bc8-8960-e0e76b0da460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:55.369081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321375-2254-4bc8-8960-e0e76b0da460 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:55.369357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321375-2254-4bc8-8960-e0e76b0da460 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:55.369627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321375-2254-4bc8-8960-e0e76b0da460 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:55.389343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53734c12-89e8-4227-a499-b76fc700e861 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:55.397522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7321375-2254-4bc8-8960-e0e76b0da460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a7321375-2254-4bc8-8960-e0e76b0da460 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:55.405697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:55.406603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:03:55.407390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:55.411362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 115/240] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:03:55.422455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7321375-2254-4bc8-8960-e0e76b0da460 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:55.429506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a6640-8f8d-422d-b698-f138eac90ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:55.430192 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6640-8f8d-422d-b698-f138eac90ef3 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:55.430495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6640-8f8d-422d-b698-f138eac90ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:55.430763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6640-8f8d-422d-b698-f138eac90ef3 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:55.431543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a6640-8f8d-422d-b698-f138eac90ef3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:55.433050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a6640-8f8d-422d-b698-f138eac90ef3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:55.465734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 126/241] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:03:55 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:03:55.589363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:55.620172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7321375-2254-4bc8-8960-e0e76b0da460 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:55.669365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61398af9-63dd-4ce2-91aa-4dbe181f96c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:55.670404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61398af9-63dd-4ce2-91aa-4dbe181f96c4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:55.670899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61398af9-63dd-4ce2-91aa-4dbe181f96c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:55.671383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61398af9-63dd-4ce2-91aa-4dbe181f96c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:55.672346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61398af9-63dd-4ce2-91aa-4dbe181f96c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:55.672842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61398af9-63dd-4ce2-91aa-4dbe181f96c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:55.674740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61398af9-63dd-4ce2-91aa-4dbe181f96c4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:55.686265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 116/242] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:55.692573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a6640-8f8d-422d-b698-f138eac90ef3 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:55.782688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:55.799629 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a6640-8f8d-422d-b698-f138eac90ef3 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:55.839597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e5b8-8b69-462a-9e1a-748cccefb432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:55.840504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e5b8-8b69-462a-9e1a-748cccefb432 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:55.840782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e5b8-8b69-462a-9e1a-748cccefb432 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:55.841055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e5b8-8b69-462a-9e1a-748cccefb432 None admin] PATH_INFO: `/v3/users/fb77d2a84f074ea1bad471784a416162` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:55.855625 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17e5b8-8b69-462a-9e1a-748cccefb432 None admin] RBAC: Authorizing `identity:get_user(user_id=fb77d2a84f074ea1bad471784a416162)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:55.857097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17e5b8-8b69-462a-9e1a-748cccefb432 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:55.859203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 127/243] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:55 2022] GET /identity/v3/users/fb77d2a84f074ea1bad471784a416162 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:55.864852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61398af9-63dd-4ce2-91aa-4dbe181f96c4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:55.970926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61398af9-63dd-4ce2-91aa-4dbe181f96c4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:56.005625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b2652-558b-4a28-8250-db65e95e183a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:56.006307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2652-558b-4a28-8250-db65e95e183a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:56.006598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2652-558b-4a28-8250-db65e95e183a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:56.006872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2652-558b-4a28-8250-db65e95e183a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:56.022506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:56.079638 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b2652-558b-4a28-8250-db65e95e183a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:56.083328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b2652-558b-4a28-8250-db65e95e183a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:56.083458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51e505-ea83-4ecd-a51b-1227ed15de35 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:56.083691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51e505-ea83-4ecd-a51b-1227ed15de35 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:56.083962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51e505-ea83-4ecd-a51b-1227ed15de35 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:56.085489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 128/244] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:03:56.090849 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab24bf-5c2d-417f-87e9-48cd496873ce None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:56.091376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab24bf-5c2d-417f-87e9-48cd496873ce None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:56.091835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab24bf-5c2d-417f-87e9-48cd496873ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:56.115553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e0ab24bf-5c2d-417f-87e9-48cd496873ce None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:56.117453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e0ab24bf-5c2d-417f-87e9-48cd496873ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:56.200856 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 129/245] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:03:56.209310 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 117/246] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:56.219457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab24bf-5c2d-417f-87e9-48cd496873ce None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:56.228832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b2652-558b-4a28-8250-db65e95e183a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:56.290676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:56.307276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:56.350672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab24bf-5c2d-417f-87e9-48cd496873ce None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:56.362920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b2652-558b-4a28-8250-db65e95e183a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:56.408124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07d715-28dc-4e8e-9e66-285b25c9a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:56.409175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07d715-28dc-4e8e-9e66-285b25c9a693 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:56.409453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07d715-28dc-4e8e-9e66-285b25c9a693 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:56.409726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07d715-28dc-4e8e-9e66-285b25c9a693 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:56.412040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07d715-28dc-4e8e-9e66-285b25c9a693 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:56.412843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07d715-28dc-4e8e-9e66-285b25c9a693 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:56.414937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 130/247] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:56 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:56.416525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f508e7e-0321-4a6c-b89b-c648d5be80fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:56.417664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f508e7e-0321-4a6c-b89b-c648d5be80fe None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:56.418134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f508e7e-0321-4a6c-b89b-c648d5be80fe None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:56.418631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f508e7e-0321-4a6c-b89b-c648d5be80fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:56.421164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17511-9392-438a-8062-cf481b823eff None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:56.421467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17511-9392-438a-8062-cf481b823eff None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:56.421742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17511-9392-438a-8062-cf481b823eff None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:56.423162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 131/248] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:56.424397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b17511-9392-438a-8062-cf481b823eff None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:56.433465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f508e7e-0321-4a6c-b89b-c648d5be80fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-6f508e7e-0321-4a6c-b89b-c648d5be80fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:56.442472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:56.443458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:56.444248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:56.447068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 118/249] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:03:56.448516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1cbc-0f1c-422b-b653-5b23fbf50a96 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:56.449005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1cbc-0f1c-422b-b653-5b23fbf50a96 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:56.449460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1cbc-0f1c-422b-b653-5b23fbf50a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:56.467478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-903a1cbc-0f1c-422b-b653-5b23fbf50a96 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:56.468966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-903a1cbc-0f1c-422b-b653-5b23fbf50a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:56.545846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 119/250] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:56.547231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a1cbc-0f1c-422b-b653-5b23fbf50a96 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:56.584325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:56.596505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b17511-9392-438a-8062-cf481b823eff None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:56.659714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4ef39-4e5b-478d-a3d8-48282bb2fd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:56.660397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4ef39-4e5b-478d-a3d8-48282bb2fd6e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:56.660674 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4ef39-4e5b-478d-a3d8-48282bb2fd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:56.660942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4ef39-4e5b-478d-a3d8-48282bb2fd6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:56.661791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4ef39-4e5b-478d-a3d8-48282bb2fd6e None admin] RBAC: Adding query filter params (role.id=5c5cdc6f15a846a0829e831d6a8949d4, scope.project.id=fa972b04f73040768b4e81de2c1b8d95, user.id=fb77d2a84f074ea1bad471784a416162) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:56.662031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a1cbc-0f1c-422b-b653-5b23fbf50a96 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:56.662131 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4ef39-4e5b-478d-a3d8-48282bb2fd6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:56.663622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4ef39-4e5b-478d-a3d8-48282bb2fd6e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:56.666879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:56.674873 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 132/251] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:56 2022] GET /identity/v3/role_assignments?user.id=fb77d2a84f074ea1bad471784a416162&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=5c5cdc6f15a846a0829e831d6a8949d4 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:56.676126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4ef39-4e5b-478d-a3d8-48282bb2fd6e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:56.742658 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284c71a-2f33-4c4e-be81-10764d56f87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:56.743758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284c71a-2f33-4c4e-be81-10764d56f87b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:56.744899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284c71a-2f33-4c4e-be81-10764d56f87b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:56.745530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284c71a-2f33-4c4e-be81-10764d56f87b None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:56.748643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284c71a-2f33-4c4e-be81-10764d56f87b None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:56.749177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284c71a-2f33-4c4e-be81-10764d56f87b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:56.750880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284c71a-2f33-4c4e-be81-10764d56f87b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:56.770692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 120/252] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:56.779506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284c71a-2f33-4c4e-be81-10764d56f87b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:56.896120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4ef39-4e5b-478d-a3d8-48282bb2fd6e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:56.949762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74536c7-bb07-4140-b4c3-394d110f4a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:56.951012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74536c7-bb07-4140-b4c3-394d110f4a8c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:56.951297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74536c7-bb07-4140-b4c3-394d110f4a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:56.951571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74536c7-bb07-4140-b4c3-394d110f4a8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:56.972594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74536c7-bb07-4140-b4c3-394d110f4a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-c74536c7-bb07-4140-b4c3-394d110f4a8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:56.985761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:56.987017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:03:56.987851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:56.989700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:56.995903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 133/253] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:03:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:56.996037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284c71a-2f33-4c4e-be81-10764d56f87b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:56.997436 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705595-c054-4c36-8488-bf46d191d3de None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:56.997727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705595-c054-4c36-8488-bf46d191d3de None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:56.998122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705595-c054-4c36-8488-bf46d191d3de None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:56.999583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 134/254] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:57.005080 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705595-c054-4c36-8488-bf46d191d3de None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:57.071325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eb5c3-1ab4-4ff6-8479-4a15e7c77048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:57.073156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb5c3-1ab4-4ff6-8479-4a15e7c77048 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:57.073788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb5c3-1ab4-4ff6-8479-4a15e7c77048 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:57.075749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb5c3-1ab4-4ff6-8479-4a15e7c77048 None admin] PATH_INFO: `/v3/users/c96fe658a5e1449993a340c063ce7125` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:57.078924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824eb5c3-1ab4-4ff6-8479-4a15e7c77048 None admin] RBAC: Authorizing `identity:get_user(user_id=c96fe658a5e1449993a340c063ce7125)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:57.080756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824eb5c3-1ab4-4ff6-8479-4a15e7c77048 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:57.083485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 121/255] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:56 2022] GET /identity/v3/users/c96fe658a5e1449993a340c063ce7125 => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:57.088898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706f97a-7b57-4ad8-b781-571bdc4bfa0d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:57.089403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706f97a-7b57-4ad8-b781-571bdc4bfa0d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:57.090560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706f97a-7b57-4ad8-b781-571bdc4bfa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:57.109495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4706f97a-7b57-4ad8-b781-571bdc4bfa0d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:57.111251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4706f97a-7b57-4ad8-b781-571bdc4bfa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:57.138649 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:57.206838 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705595-c054-4c36-8488-bf46d191d3de None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:57.227327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 122/256] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:57.230530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706f97a-7b57-4ad8-b781-571bdc4bfa0d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:57.269408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961114e9-635d-4797-a222-ead099e2e22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:57.270783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961114e9-635d-4797-a222-ead099e2e22a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:57.271260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961114e9-635d-4797-a222-ead099e2e22a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:57.272741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961114e9-635d-4797-a222-ead099e2e22a None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:57.273710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961114e9-635d-4797-a222-ead099e2e22a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:57.274412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961114e9-635d-4797-a222-ead099e2e22a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:57.277126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961114e9-635d-4797-a222-ead099e2e22a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:57.288136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 135/257] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:57.289341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961114e9-635d-4797-a222-ead099e2e22a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:57.406115 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961114e9-635d-4797-a222-ead099e2e22a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:57.411014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:57.421625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706f97a-7b57-4ad8-b781-571bdc4bfa0d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:57.453343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647e1c8-1ba3-481d-ac64-6cc5e98f5976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:57.454580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e1c8-1ba3-481d-ac64-6cc5e98f5976 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:57.455172 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e1c8-1ba3-481d-ac64-6cc5e98f5976 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:57.455632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e1c8-1ba3-481d-ac64-6cc5e98f5976 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:57.468422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647e1c8-1ba3-481d-ac64-6cc5e98f5976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-0647e1c8-1ba3-481d-ac64-6cc5e98f5976 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:57.478695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:57.479569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:03:57.480361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:03:57.482853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 136/258] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:03:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:57.486489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:57.487004 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647e1c8-1ba3-481d-ac64-6cc5e98f5976 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:57.507013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59906ca3-b420-4ddb-b47a-817198a46c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:57.507910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59906ca3-b420-4ddb-b47a-817198a46c33 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:57.508191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59906ca3-b420-4ddb-b47a-817198a46c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:57.508460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59906ca3-b420-4ddb-b47a-817198a46c33 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:57.513665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59906ca3-b420-4ddb-b47a-817198a46c33 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:57.515228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59906ca3-b420-4ddb-b47a-817198a46c33 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:57.517504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 123/259] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:57 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:57.518456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59906ca3-b420-4ddb-b47a-817198a46c33 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:57.622632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647e1c8-1ba3-481d-ac64-6cc5e98f5976 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:57.661255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf629d9-85a7-499c-bd9b-38d1e3af2f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:57.662555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf629d9-85a7-499c-bd9b-38d1e3af2f4d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:57.663065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf629d9-85a7-499c-bd9b-38d1e3af2f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:57.663914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf629d9-85a7-499c-bd9b-38d1e3af2f4d None admin] PATH_INFO: `/v3/users/268089ef33404a8ab03d66d1e0e4cc78` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:57.665363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf629d9-85a7-499c-bd9b-38d1e3af2f4d None admin] RBAC: Authorizing `identity:get_user(user_id=268089ef33404a8ab03d66d1e0e4cc78)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:57.667365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf629d9-85a7-499c-bd9b-38d1e3af2f4d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:57.669520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 137/260] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:57 2022] GET /identity/v3/users/268089ef33404a8ab03d66d1e0e4cc78 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:57.670589 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf629d9-85a7-499c-bd9b-38d1e3af2f4d None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:57.753357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59906ca3-b420-4ddb-b47a-817198a46c33 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:57.781403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:57.820487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39240f-9379-458d-805a-c0dc1028c415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:57.821677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39240f-9379-458d-805a-c0dc1028c415 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:57.822153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39240f-9379-458d-805a-c0dc1028c415 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:57.822635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39240f-9379-458d-805a-c0dc1028c415 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:57.823594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39240f-9379-458d-805a-c0dc1028c415 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:57.824089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39240f-9379-458d-805a-c0dc1028c415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:57.825691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39240f-9379-458d-805a-c0dc1028c415 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:57.834752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 124/261] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:03:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:57.835851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39240f-9379-458d-805a-c0dc1028c415 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:57.861955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:57.903435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf629d9-85a7-499c-bd9b-38d1e3af2f4d None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:57.948558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39240f-9379-458d-805a-c0dc1028c415 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:57.961133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4450d9-17a9-4cc6-bb7d-1c6b4726c876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:57.962058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4450d9-17a9-4cc6-bb7d-1c6b4726c876 None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:57.962355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4450d9-17a9-4cc6-bb7d-1c6b4726c876 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:57.962630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4450d9-17a9-4cc6-bb7d-1c6b4726c876 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95/users/c96fe658a5e1449993a340c063ce7125/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:57.967889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4450d9-17a9-4cc6-bb7d-1c6b4726c876 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa972b04f73040768b4e81de2c1b8d95, user_id=c96fe658a5e1449993a340c063ce7125, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:57.969361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4450d9-17a9-4cc6-bb7d-1c6b4726c876 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:57.988786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 138/262] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:03:57 2022] PUT /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95/users/c96fe658a5e1449993a340c063ce7125/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:03:57.992120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4450d9-17a9-4cc6-bb7d-1c6b4726c876 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:58.028222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729de05-d1f8-41a6-8c15-8eae4577d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:58.029721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729de05-d1f8-41a6-8c15-8eae4577d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:58.030007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729de05-d1f8-41a6-8c15-8eae4577d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:58.030284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729de05-d1f8-41a6-8c15-8eae4577d8e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:58.202222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729de05-d1f8-41a6-8c15-8eae4577d8e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:58.203780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729de05-d1f8-41a6-8c15-8eae4577d8e2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:58.230337 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:58.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4450d9-17a9-4cc6-bb7d-1c6b4726c876 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:58.261448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:58.310926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 125/263] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:58.316748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729de05-d1f8-41a6-8c15-8eae4577d8e2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:58.342692 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15352ff0-7e9f-4871-94ae-ac247999332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:58.343633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352ff0-7e9f-4871-94ae-ac247999332d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:58.343912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352ff0-7e9f-4871-94ae-ac247999332d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:58.344183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352ff0-7e9f-4871-94ae-ac247999332d None admin] PATH_INFO: `/v3/users/268089ef33404a8ab03d66d1e0e4cc78` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:58.345534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15352ff0-7e9f-4871-94ae-ac247999332d None admin] RBAC: Authorizing `identity:get_user(user_id=268089ef33404a8ab03d66d1e0e4cc78)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:58.347010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15352ff0-7e9f-4871-94ae-ac247999332d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:58.348995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 139/264] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:57 2022] GET /identity/v3/users/268089ef33404a8ab03d66d1e0e4cc78 => generated 283 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:58.355267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15352ff0-7e9f-4871-94ae-ac247999332d None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:58.422333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729de05-d1f8-41a6-8c15-8eae4577d8e2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:58.452339 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:58.465804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce3dc8-8024-42e0-9618-a51981354557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:58.466786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3dc8-8024-42e0-9618-a51981354557 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:58.467073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3dc8-8024-42e0-9618-a51981354557 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:58.467336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3dc8-8024-42e0-9618-a51981354557 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:58.468541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce3dc8-8024-42e0-9618-a51981354557 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:58.471243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce3dc8-8024-42e0-9618-a51981354557 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:58.473330 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 126/265] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:58 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:58.478999 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce3dc8-8024-42e0-9618-a51981354557 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:58.582832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce3dc8-8024-42e0-9618-a51981354557 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:58.622794 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddd350-f71f-462d-b238-f6a0a94406f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:58.623466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd350-f71f-462d-b238-f6a0a94406f6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:58.623747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd350-f71f-462d-b238-f6a0a94406f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:58.624016 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd350-f71f-462d-b238-f6a0a94406f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:58.624854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ddd350-f71f-462d-b238-f6a0a94406f6 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=fa972b04f73040768b4e81de2c1b8d95, user.id=268089ef33404a8ab03d66d1e0e4cc78) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:58.625160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ddd350-f71f-462d-b238-f6a0a94406f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:58.626710 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ddd350-f71f-462d-b238-f6a0a94406f6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:58.638830 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 127/266] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:58 2022] GET /identity/v3/role_assignments?user.id=268089ef33404a8ab03d66d1e0e4cc78&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:58.653074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15352ff0-7e9f-4871-94ae-ac247999332d None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:58.723717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b000cc7-a56b-4ffe-95cb-2d7384453e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:58.724408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b000cc7-a56b-4ffe-95cb-2d7384453e7d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:58.724689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b000cc7-a56b-4ffe-95cb-2d7384453e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:58.724959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b000cc7-a56b-4ffe-95cb-2d7384453e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:58.818162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:58.835889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa36519-cf03-411b-88d1-7d421a618c8e None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:58.836081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa36519-cf03-411b-88d1-7d421a618c8e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:58.836355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa36519-cf03-411b-88d1-7d421a618c8e None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:58.838111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 128/267] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:03:58.843909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fe327-b469-4273-8516-83ebd13c1f92 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:58.844209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fe327-b469-4273-8516-83ebd13c1f92 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:58.844468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fe327-b469-4273-8516-83ebd13c1f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:58.853407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b000cc7-a56b-4ffe-95cb-2d7384453e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:58.856804 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b000cc7-a56b-4ffe-95cb-2d7384453e7d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:58.878841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b73fe327-b469-4273-8516-83ebd13c1f92 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:58.880068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b73fe327-b469-4273-8516-83ebd13c1f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:59.003733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:59.009333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 140/268] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:03:59.011103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b72189-86f7-40f8-be38-5b690f487d74 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.011532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b72189-86f7-40f8-be38-5b690f487d74 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.011934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b72189-86f7-40f8-be38-5b690f487d74 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.013411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 141/269] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:59.014788 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b72189-86f7-40f8-be38-5b690f487d74 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:59.028521 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 129/270] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:59.030071 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe65a2-2963-44f2-992e-fbf2a9ae50b7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.030498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe65a2-2963-44f2-992e-fbf2a9ae50b7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.031000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe65a2-2963-44f2-992e-fbf2a9ae50b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.055618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ccfe65a2-2963-44f2-992e-fbf2a9ae50b7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:59.062779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ccfe65a2-2963-44f2-992e-fbf2a9ae50b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:59.107409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:59.127501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b72189-86f7-40f8-be38-5b690f487d74 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:59.150057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 130/271] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:59.151168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe65a2-2963-44f2-992e-fbf2a9ae50b7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:59.166492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8bc5e-7135-4fc8-93db-f367574e3798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:59.167680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8bc5e-7135-4fc8-93db-f367574e3798 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.168100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8bc5e-7135-4fc8-93db-f367574e3798 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.168507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8bc5e-7135-4fc8-93db-f367574e3798 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.169839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8bc5e-7135-4fc8-93db-f367574e3798 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:59.171557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8bc5e-7135-4fc8-93db-f367574e3798 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:59.174994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 142/272] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:03:59 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:59.180379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8bc5e-7135-4fc8-93db-f367574e3798 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:59.272781 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe65a2-2963-44f2-992e-fbf2a9ae50b7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:59.289858 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:59.297442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8bc5e-7135-4fc8-93db-f367574e3798 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:59.309329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f790d6-04bc-4911-acd3-8733d3bc1deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:59.310148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f790d6-04bc-4911-acd3-8733d3bc1deb None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.310465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f790d6-04bc-4911-acd3-8733d3bc1deb None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.310742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f790d6-04bc-4911-acd3-8733d3bc1deb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.311914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f790d6-04bc-4911-acd3-8733d3bc1deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:59.313398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f790d6-04bc-4911-acd3-8733d3bc1deb None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:59.315242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 131/273] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:03:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:59.320442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f790d6-04bc-4911-acd3-8733d3bc1deb None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:59.333154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f350ec-a897-4227-a449-43096136d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:59.333828 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f350ec-a897-4227-a449-43096136d53a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.334116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f350ec-a897-4227-a449-43096136d53a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.334407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f350ec-a897-4227-a449-43096136d53a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.335236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f350ec-a897-4227-a449-43096136d53a None admin] RBAC: Adding query filter params (role.id=66ac9c3671cb46b6ae847fdbc68015b3, scope.project.id=fa972b04f73040768b4e81de2c1b8d95, user.id=268089ef33404a8ab03d66d1e0e4cc78) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:59.335553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f350ec-a897-4227-a449-43096136d53a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:59.336990 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f350ec-a897-4227-a449-43096136d53a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:59.343917 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 143/274] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:03:59 2022] GET /identity/v3/role_assignments?user.id=268089ef33404a8ab03d66d1e0e4cc78&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=66ac9c3671cb46b6ae847fdbc68015b3 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:59.345444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d481a6-2043-4ad1-bcae-d56426e248bf None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.346001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d481a6-2043-4ad1-bcae-d56426e248bf None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.346494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d481a6-2043-4ad1-bcae-d56426e248bf None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.347986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 144/275] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:03:59.348839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d481a6-2043-4ad1-bcae-d56426e248bf None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:59.370024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:59.461759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f790d6-04bc-4911-acd3-8733d3bc1deb None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:59.486127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d481a6-2043-4ad1-bcae-d56426e248bf None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:59.512623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dee3e-f63b-4538-b833-276f631af153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:59.512623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dee3e-f63b-4538-b833-276f631af153 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.512623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dee3e-f63b-4538-b833-276f631af153 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.512623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dee3e-f63b-4538-b833-276f631af153 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.527260 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86dee3e-f63b-4538-b833-276f631af153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:59.531693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b42f9d-c397-4a78-b81f-d1b916f25441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:59.532381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42f9d-c397-4a78-b81f-d1b916f25441 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.532658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42f9d-c397-4a78-b81f-d1b916f25441 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.532998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42f9d-c397-4a78-b81f-d1b916f25441 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.533954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b42f9d-c397-4a78-b81f-d1b916f25441 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a86dee3e-f63b-4538-b833-276f631af153 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:59.535376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:59.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:03:59.537051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:59.537640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b42f9d-c397-4a78-b81f-d1b916f25441 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:59.537707 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 132/276] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:03:59.538168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71cf82-7bbc-4f63-9fd2-6a59524b03d4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.538343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71cf82-7bbc-4f63-9fd2-6a59524b03d4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.538845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71cf82-7bbc-4f63-9fd2-6a59524b03d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.559461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ef71cf82-7bbc-4f63-9fd2-6a59524b03d4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:03:59.560023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 145/277] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:03:59 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:03:59.560603 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b42f9d-c397-4a78-b81f-d1b916f25441 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:59.560937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ef71cf82-7bbc-4f63-9fd2-6a59524b03d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:03:59.622577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:59.659780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 133/278] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:03:59.664332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:59.698519 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b42f9d-c397-4a78-b81f-d1b916f25441 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:59.702096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71cf82-7bbc-4f63-9fd2-6a59524b03d4 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:59.739980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b98b9-234d-4dbd-b2a1-204978edf0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:59.740409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b98b9-234d-4dbd-b2a1-204978edf0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.740691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b98b9-234d-4dbd-b2a1-204978edf0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.741328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b98b9-234d-4dbd-b2a1-204978edf0e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.742138 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b98b9-234d-4dbd-b2a1-204978edf0e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:03:59.742449 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b98b9-234d-4dbd-b2a1-204978edf0e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:59.743886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b98b9-234d-4dbd-b2a1-204978edf0e0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:59.753572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 146/279] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:03:59.759088 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b98b9-234d-4dbd-b2a1-204978edf0e0 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:59.839143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71cf82-7bbc-4f63-9fd2-6a59524b03d4 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:59.883249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8a60b-d633-4fa1-bffe-ba4164dc8859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:59.884315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a60b-d633-4fa1-bffe-ba4164dc8859 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.884605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a60b-d633-4fa1-bffe-ba4164dc8859 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.884887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a60b-d633-4fa1-bffe-ba4164dc8859 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.896975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8a60b-d633-4fa1-bffe-ba4164dc8859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:03:59.900756 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b98b9-234d-4dbd-b2a1-204978edf0e0 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c4d8a60b-d633-4fa1-bffe-ba4164dc8859 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:03:59.905054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:03:59.905948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:03:59.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 134/280] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:03:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:03:59.912565 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8a60b-d633-4fa1-bffe-ba4164dc8859 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:03:59.943333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:59.956442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8df94-84c5-412c-8c6b-0ddab308a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:03:59.957858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8df94-84c5-412c-8c6b-0ddab308a588 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:03:59.958350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8df94-84c5-412c-8c6b-0ddab308a588 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:03:59.958756 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8df94-84c5-412c-8c6b-0ddab308a588 None admin] PATH_INFO: `/v3/users/26e4e06acec54b209cb938ce7ba2abce` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:03:59.961120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:03:59.975717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8df94-84c5-412c-8c6b-0ddab308a588 None admin] RBAC: Authorizing `identity:get_user(user_id=26e4e06acec54b209cb938ce7ba2abce)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:03:59.977219 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8df94-84c5-412c-8c6b-0ddab308a588 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:03:59.979344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 147/281] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:03:59 2022] GET /identity/v3/users/26e4e06acec54b209cb938ce7ba2abce => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:03:59.985138 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8df94-84c5-412c-8c6b-0ddab308a588 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:00.043382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8a60b-d633-4fa1-bffe-ba4164dc8859 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:00.090178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67af1f-2396-4a63-a67e-7277e3b2812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:00.091240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67af1f-2396-4a63-a67e-7277e3b2812f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:00.091911 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67af1f-2396-4a63-a67e-7277e3b2812f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:00.092326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67af1f-2396-4a63-a67e-7277e3b2812f None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:00.093920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67af1f-2396-4a63-a67e-7277e3b2812f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:00.094395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67af1f-2396-4a63-a67e-7277e3b2812f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:00.096586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67af1f-2396-4a63-a67e-7277e3b2812f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:00.100999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8df94-84c5-412c-8c6b-0ddab308a588 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:00.107704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 135/282] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:03:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:00.113438 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67af1f-2396-4a63-a67e-7277e3b2812f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:00.141966 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24385ba-d0a0-4eea-a953-4f4b00c50dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:00.143126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24385ba-d0a0-4eea-a953-4f4b00c50dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:00.143551 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24385ba-d0a0-4eea-a953-4f4b00c50dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:00.144079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24385ba-d0a0-4eea-a953-4f4b00c50dc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:00.144925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24385ba-d0a0-4eea-a953-4f4b00c50dc8 None admin] RBAC: Adding query filter params (role.id=86e9a6602f6945d7b87811b8708df6b7, user.id=26e4e06acec54b209cb938ce7ba2abce, scope.system=all) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:00.145238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24385ba-d0a0-4eea-a953-4f4b00c50dc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:00.146934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24385ba-d0a0-4eea-a953-4f4b00c50dc8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:00.155006 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 148/283] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Jun 28 03:03:59 2022] GET /identity/v3/role_assignments?user.id=26e4e06acec54b209cb938ce7ba2abce&scope.system=all&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:00.257110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:00.263319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67af1f-2396-4a63-a67e-7277e3b2812f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:00.302132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093d735-2926-4711-b08a-16bcca265a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:00.303070 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d735-2926-4711-b08a-16bcca265a2d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:00.303343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d735-2926-4711-b08a-16bcca265a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:00.303614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d735-2926-4711-b08a-16bcca265a2d None admin] PATH_INFO: `/v3/users/fb77d2a84f074ea1bad471784a416162` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:00.304946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093d735-2926-4711-b08a-16bcca265a2d None admin] RBAC: Authorizing `identity:get_user(user_id=fb77d2a84f074ea1bad471784a416162)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:00.306452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093d735-2926-4711-b08a-16bcca265a2d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:00.308466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 136/284] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:04:00 2022] GET /identity/v3/users/fb77d2a84f074ea1bad471784a416162 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:00.313733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24385ba-d0a0-4eea-a953-4f4b00c50dc8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:00.409161 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:00.485049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24385ba-d0a0-4eea-a953-4f4b00c50dc8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:00.528795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99e8eb-70da-493a-b86b-dd4ded7e3bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:00.529679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e8eb-70da-493a-b86b-dd4ded7e3bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:00.529957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e8eb-70da-493a-b86b-dd4ded7e3bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:00.530223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e8eb-70da-493a-b86b-dd4ded7e3bc3 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:00.531439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99e8eb-70da-493a-b86b-dd4ded7e3bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:00.533278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99e8eb-70da-493a-b86b-dd4ded7e3bc3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:00.535907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 149/285] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:00 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:00.541612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093d735-2926-4711-b08a-16bcca265a2d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:00.647131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093d735-2926-4711-b08a-16bcca265a2d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:00.682910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593d981-e84c-4327-a2a0-a9183c14a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:00.683796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593d981-e84c-4327-a2a0-a9183c14a050 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:00.684074 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593d981-e84c-4327-a2a0-a9183c14a050 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:00.684342 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593d981-e84c-4327-a2a0-a9183c14a050 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95/users/fb77d2a84f074ea1bad471784a416162/roles/5c5cdc6f15a846a0829e831d6a8949d4` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:00.686487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593d981-e84c-4327-a2a0-a9183c14a050 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa972b04f73040768b4e81de2c1b8d95, user_id=fb77d2a84f074ea1bad471784a416162, role_id=5c5cdc6f15a846a0829e831d6a8949d4)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:00.688041 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593d981-e84c-4327-a2a0-a9183c14a050 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:00.713144 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 137/286] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:04:00 2022] PUT /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95/users/fb77d2a84f074ea1bad471784a416162/roles/5c5cdc6f15a846a0829e831d6a8949d4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:01.082149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201184e2-cacb-44da-991b-b4a056937fa7 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:01.083119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201184e2-cacb-44da-991b-b4a056937fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:01.083577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201184e2-cacb-44da-991b-b4a056937fa7 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:01.085411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 150/287] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:01.091156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685c049-8823-4093-aaa9-982bf01cce8d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:01.091655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685c049-8823-4093-aaa9-982bf01cce8d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:01.092110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685c049-8823-4093-aaa9-982bf01cce8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:01.118852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1685c049-8823-4093-aaa9-982bf01cce8d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:01.120368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1685c049-8823-4093-aaa9-982bf01cce8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:01.139088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:01.193266 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 138/288] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:01.216343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201184e2-cacb-44da-991b-b4a056937fa7 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:01.324913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201184e2-cacb-44da-991b-b4a056937fa7 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:01.342722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:01.361941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6645c0-3ee4-4825-8c52-a32f7ba0a018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:01.363116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6645c0-3ee4-4825-8c52-a32f7ba0a018 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:01.363600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6645c0-3ee4-4825-8c52-a32f7ba0a018 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:01.364065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6645c0-3ee4-4825-8c52-a32f7ba0a018 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:01.375185 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6645c0-3ee4-4825-8c52-a32f7ba0a018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-0a6645c0-3ee4-4825-8c52-a32f7ba0a018 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:01.383435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:01.384293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:01.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:01.387759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 151/289] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:01.394253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685c049-8823-4093-aaa9-982bf01cce8d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:01.531930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685c049-8823-4093-aaa9-982bf01cce8d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:01.573289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec3d8c-0734-414f-97d9-5032d2a18c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:01.573986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec3d8c-0734-414f-97d9-5032d2a18c9c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:01.574264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec3d8c-0734-414f-97d9-5032d2a18c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:01.574557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec3d8c-0734-414f-97d9-5032d2a18c9c None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:01.575373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec3d8c-0734-414f-97d9-5032d2a18c9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:01.575621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec3d8c-0734-414f-97d9-5032d2a18c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:01.577018 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec3d8c-0734-414f-97d9-5032d2a18c9c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:01.590555 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 139/290] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:01.596135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6645c0-3ee4-4825-8c52-a32f7ba0a018 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:01.733385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6645c0-3ee4-4825-8c52-a32f7ba0a018 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:01.768087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d846f-e92d-4fa7-9964-59524f704a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:01.769170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d846f-e92d-4fa7-9964-59524f704a49 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:01.769456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d846f-e92d-4fa7-9964-59524f704a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:01.769735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d846f-e92d-4fa7-9964-59524f704a49 None admin] PATH_INFO: `/v3/users/c96fe658a5e1449993a340c063ce7125` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:01.771114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d846f-e92d-4fa7-9964-59524f704a49 None admin] RBAC: Authorizing `identity:get_user(user_id=c96fe658a5e1449993a340c063ce7125)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:01.772566 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d846f-e92d-4fa7-9964-59524f704a49 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:01.774217 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 152/291] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:04:01 2022] GET /identity/v3/users/c96fe658a5e1449993a340c063ce7125 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:01.779733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec3d8c-0734-414f-97d9-5032d2a18c9c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:01.798649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:01.883964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec3d8c-0734-414f-97d9-5032d2a18c9c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:01.925978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daf0d6-8684-4cae-88fe-c762cc398bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:01.926722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daf0d6-8684-4cae-88fe-c762cc398bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:01.927160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daf0d6-8684-4cae-88fe-c762cc398bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:01.927482 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daf0d6-8684-4cae-88fe-c762cc398bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:02.012018 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daf0d6-8684-4cae-88fe-c762cc398bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:02.013504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daf0d6-8684-4cae-88fe-c762cc398bf6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:02.030904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:02.136549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 140/292] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:02.142033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d846f-e92d-4fa7-9964-59524f704a49 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:02.193321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:02.236947 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea14f8d-9567-4334-a4d1-f82686510307 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:02.237265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea14f8d-9567-4334-a4d1-f82686510307 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:02.237506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea14f8d-9567-4334-a4d1-f82686510307 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:02.240277 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 141/293] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:02.245131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb82735-4733-4d0e-b6bb-b6b9bfe00e07 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:02.245458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb82735-4733-4d0e-b6bb-b6b9bfe00e07 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:02.245678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb82735-4733-4d0e-b6bb-b6b9bfe00e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:02.263852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-afb82735-4733-4d0e-b6bb-b6b9bfe00e07 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:02.265041 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-afb82735-4733-4d0e-b6bb-b6b9bfe00e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:02.281434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d846f-e92d-4fa7-9964-59524f704a49 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:02.335002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 142/294] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:02.349371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ac03a-6e97-45b5-8703-aa6d26909328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:02.350271 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ac03a-6e97-45b5-8703-aa6d26909328 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:02.350572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ac03a-6e97-45b5-8703-aa6d26909328 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:02.350843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ac03a-6e97-45b5-8703-aa6d26909328 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:02.352055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ac03a-6e97-45b5-8703-aa6d26909328 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:02.353501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ac03a-6e97-45b5-8703-aa6d26909328 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:02.355265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 153/295] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:02 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:02.361368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb82735-4733-4d0e-b6bb-b6b9bfe00e07 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:02.400434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ac03a-6e97-45b5-8703-aa6d26909328 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:02.434923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:02.531582 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb82735-4733-4d0e-b6bb-b6b9bfe00e07 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:02.563313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ac03a-6e97-45b5-8703-aa6d26909328 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:02.582650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:02.602944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f835b9a-36bd-44b8-bcc4-0215d222a917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:02.603760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835b9a-36bd-44b8-bcc4-0215d222a917 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:02.604036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835b9a-36bd-44b8-bcc4-0215d222a917 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:02.604307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835b9a-36bd-44b8-bcc4-0215d222a917 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:02.613787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c16cc-79e9-45b4-9276-1dffe4c9e7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:02.614481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c16cc-79e9-45b4-9276-1dffe4c9e7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:02.614765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c16cc-79e9-45b4-9276-1dffe4c9e7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:02.615031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c16cc-79e9-45b4-9276-1dffe4c9e7e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:02.616226 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c16cc-79e9-45b4-9276-1dffe4c9e7e9 None admin] RBAC: Adding query filter params (role.id=86e9a6602f6945d7b87811b8708df6b7, scope.project.id=fa972b04f73040768b4e81de2c1b8d95, user.id=c96fe658a5e1449993a340c063ce7125) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:02.616529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c16cc-79e9-45b4-9276-1dffe4c9e7e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:02.617986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c16cc-79e9-45b4-9276-1dffe4c9e7e9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:02.631134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f835b9a-36bd-44b8-bcc4-0215d222a917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-1f835b9a-36bd-44b8-bcc4-0215d222a917 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:02.639121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:02.640067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:04:02.640854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:02.641455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 143/296] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:02 2022] GET /identity/v3/role_assignments?user.id=c96fe658a5e1449993a340c063ce7125&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:02.641526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 154/297] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:02.651608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c16cc-79e9-45b4-9276-1dffe4c9e7e9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:02.655793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641dacd-bab2-4419-bc57-3bd6c24a7f3a None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:02.656399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641dacd-bab2-4419-bc57-3bd6c24a7f3a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:02.656862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641dacd-bab2-4419-bc57-3bd6c24a7f3a None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:02.659124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 155/298] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:04:02.669731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36469ddc-cf19-4f1a-a8ab-5e8a67f7233f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:02.670402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36469ddc-cf19-4f1a-a8ab-5e8a67f7233f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:02.670976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36469ddc-cf19-4f1a-a8ab-5e8a67f7233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:02.718661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-36469ddc-cf19-4f1a-a8ab-5e8a67f7233f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:02.719904 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-36469ddc-cf19-4f1a-a8ab-5e8a67f7233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:02.828967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c16cc-79e9-45b4-9276-1dffe4c9e7e9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:02.837582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 156/299] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:02.844175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:02.862747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36469ddc-cf19-4f1a-a8ab-5e8a67f7233f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:02.871409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073da2d-9b40-4b73-8ad7-9a2bc8d18b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:02.872100 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073da2d-9b40-4b73-8ad7-9a2bc8d18b69 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:02.872378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073da2d-9b40-4b73-8ad7-9a2bc8d18b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:02.872648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073da2d-9b40-4b73-8ad7-9a2bc8d18b69 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:02.873401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073da2d-9b40-4b73-8ad7-9a2bc8d18b69 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:02.873705 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073da2d-9b40-4b73-8ad7-9a2bc8d18b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:02.875276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073da2d-9b40-4b73-8ad7-9a2bc8d18b69 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:02.885841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 144/300] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:02.891106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073da2d-9b40-4b73-8ad7-9a2bc8d18b69 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:03.000572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36469ddc-cf19-4f1a-a8ab-5e8a67f7233f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:03.002765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:03.008217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073da2d-9b40-4b73-8ad7-9a2bc8d18b69 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:03.037120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103b3c0-28ad-4095-b071-3f8e661bb5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:03.037931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103b3c0-28ad-4095-b071-3f8e661bb5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.038209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103b3c0-28ad-4095-b071-3f8e661bb5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.038513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103b3c0-28ad-4095-b071-3f8e661bb5c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.039662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103b3c0-28ad-4095-b071-3f8e661bb5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:03.041103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103b3c0-28ad-4095-b071-3f8e661bb5c6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:03.043784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94797a-5e7a-40ac-9e53-ef06aad20ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:03.043784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94797a-5e7a-40ac-9e53-ef06aad20ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.043784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94797a-5e7a-40ac-9e53-ef06aad20ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.044023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94797a-5e7a-40ac-9e53-ef06aad20ed5 None admin] PATH_INFO: `/v3/users/1af758ce0642455786b4ec3faadee644` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.047478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 157/301] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:03.049006 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2795c-96e8-43c6-9ecc-281e19e307d8 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.049290 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2795c-96e8-43c6-9ecc-281e19e307d8 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.049559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2795c-96e8-43c6-9ecc-281e19e307d8 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.050928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 158/302] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:03.055083 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2795c-96e8-43c6-9ecc-281e19e307d8 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:03.063558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94797a-5e7a-40ac-9e53-ef06aad20ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=1af758ce0642455786b4ec3faadee644)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:03.065406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94797a-5e7a-40ac-9e53-ef06aad20ed5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:03.071700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 145/303] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:04:02 2022] GET /identity/v3/users/1af758ce0642455786b4ec3faadee644 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:03.071700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818013f-f07f-4a93-b4dd-5f64dae54ef8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.071700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818013f-f07f-4a93-b4dd-5f64dae54ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.071700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818013f-f07f-4a93-b4dd-5f64dae54ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.089022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4818013f-f07f-4a93-b4dd-5f64dae54ef8 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:03.090300 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4818013f-f07f-4a93-b4dd-5f64dae54ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:03.117542 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:03.167716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2795c-96e8-43c6-9ecc-281e19e307d8 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:03.168302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 146/304] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:03.168992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818013f-f07f-4a93-b4dd-5f64dae54ef8 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:03.213841 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90da14-25c5-453e-abab-9c5ddeadccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:03.214536 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90da14-25c5-453e-abab-9c5ddeadccf9 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.214815 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90da14-25c5-453e-abab-9c5ddeadccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.215084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90da14-25c5-453e-abab-9c5ddeadccf9 None admin] PATH_INFO: `/v3/groups` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.215784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90da14-25c5-453e-abab-9c5ddeadccf9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:03.217227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90da14-25c5-453e-abab-9c5ddeadccf9 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:03.232210 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 159/305] 10.222.0.23 () {60 vars in 1134 bytes} [Tue Jun 28 03:04:03 2022] POST /identity/v3/groups => generated 229 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:04:03.233280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90da14-25c5-453e-abab-9c5ddeadccf9 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:03.270466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:03.309181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818013f-f07f-4a93-b4dd-5f64dae54ef8 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:03.351317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90da14-25c5-453e-abab-9c5ddeadccf9 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:03.351978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8239ca-191f-43b7-8118-81612d97aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:03.352659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8239ca-191f-43b7-8118-81612d97aa95 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.352940 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8239ca-191f-43b7-8118-81612d97aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.353255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8239ca-191f-43b7-8118-81612d97aa95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.354054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8239ca-191f-43b7-8118-81612d97aa95 None admin] RBAC: Adding query filter params (role.id=5c5cdc6f15a846a0829e831d6a8949d4, user.id=1af758ce0642455786b4ec3faadee644, scope.system=all) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:03.354390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8239ca-191f-43b7-8118-81612d97aa95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:03.355868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8239ca-191f-43b7-8118-81612d97aa95 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:03.361914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 147/306] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Jun 28 03:04:03 2022] GET /identity/v3/role_assignments?user.id=1af758ce0642455786b4ec3faadee644&scope.system=all&role.id=5c5cdc6f15a846a0829e831d6a8949d4 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:03.363148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f58c-75ef-4cc9-b8d2-7567f8487403 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.363428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f58c-75ef-4cc9-b8d2-7567f8487403 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.363700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f58c-75ef-4cc9-b8d2-7567f8487403 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.365225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 148/307] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:03.371410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e074af-08de-4856-978d-d899ddcaba4a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.371767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e074af-08de-4856-978d-d899ddcaba4a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.371975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e074af-08de-4856-978d-d899ddcaba4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.392312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-47e074af-08de-4856-978d-d899ddcaba4a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:03.393671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-47e074af-08de-4856-978d-d899ddcaba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:03.406202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96588de0-1211-42a8-a003-2f4f24696657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:03.407434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96588de0-1211-42a8-a003-2f4f24696657 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.408074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96588de0-1211-42a8-a003-2f4f24696657 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.408439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96588de0-1211-42a8-a003-2f4f24696657 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.415145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:03.422260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96588de0-1211-42a8-a003-2f4f24696657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-96588de0-1211-42a8-a003-2f4f24696657 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:03.430494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:03.431446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:03.432231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 160/308] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:03.440098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96588de0-1211-42a8-a003-2f4f24696657 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:03.487960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 149/309] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:03.512428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e074af-08de-4856-978d-d899ddcaba4a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:03.566561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96588de0-1211-42a8-a003-2f4f24696657 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:03.570053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:03.609037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b0795-7d2a-42f7-a5b1-ad2868c68aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:03.609724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b0795-7d2a-42f7-a5b1-ad2868c68aec None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.610003 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b0795-7d2a-42f7-a5b1-ad2868c68aec None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.610273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b0795-7d2a-42f7-a5b1-ad2868c68aec None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.611406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b0795-7d2a-42f7-a5b1-ad2868c68aec None admin] RBAC: Adding query filter params (name=member) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:03.611753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b0795-7d2a-42f7-a5b1-ad2868c68aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:03.613227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b0795-7d2a-42f7-a5b1-ad2868c68aec None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:03.621684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e074af-08de-4856-978d-d899ddcaba4a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:03.622903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 161/310] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:03.628180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b0795-7d2a-42f7-a5b1-ad2868c68aec None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:03.660099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca9a49-c52e-4a58-9632-07a53da89eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:03.661001 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca9a49-c52e-4a58-9632-07a53da89eab None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.661301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca9a49-c52e-4a58-9632-07a53da89eab None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.661644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca9a49-c52e-4a58-9632-07a53da89eab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.672608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca9a49-c52e-4a58-9632-07a53da89eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-78ca9a49-c52e-4a58-9632-07a53da89eab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:03.682023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:03.682987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:03.683817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 150/311] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:03.691194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca9a49-c52e-4a58-9632-07a53da89eab None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:03.710004 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:03.734063 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b0795-7d2a-42f7-a5b1-ad2868c68aec None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:03.768825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6d49-dba0-4613-b6be-22de7d7e2166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:03.770148 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6d49-dba0-4613-b6be-22de7d7e2166 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.770607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6d49-dba0-4613-b6be-22de7d7e2166 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.771011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6d49-dba0-4613-b6be-22de7d7e2166 None admin] PATH_INFO: `/v3/users/26e4e06acec54b209cb938ce7ba2abce` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.772365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6d49-dba0-4613-b6be-22de7d7e2166 None admin] RBAC: Authorizing `identity:get_user(user_id=26e4e06acec54b209cb938ce7ba2abce)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:03.773951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6d49-dba0-4613-b6be-22de7d7e2166 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:03.780531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 162/312] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:04:03 2022] GET /identity/v3/users/26e4e06acec54b209cb938ce7ba2abce => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:03.781558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6d49-dba0-4613-b6be-22de7d7e2166 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:03.802124 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca9a49-c52e-4a58-9632-07a53da89eab None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:03.805345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:03.838152 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23f7cb-70ce-4556-ae5a-0361d934a7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:03.838905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f7cb-70ce-4556-ae5a-0361d934a7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.839040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f7cb-70ce-4556-ae5a-0361d934a7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.839295 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f7cb-70ce-4556-ae5a-0361d934a7f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.840059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23f7cb-70ce-4556-ae5a-0361d934a7f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:03.840394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23f7cb-70ce-4556-ae5a-0361d934a7f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:03.841852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23f7cb-70ce-4556-ae5a-0361d934a7f0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:03.854970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 151/313] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:03.856364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23f7cb-70ce-4556-ae5a-0361d934a7f0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:03.914736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6d49-dba0-4613-b6be-22de7d7e2166 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:03.946688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:03.957062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0f809-0128-49c2-b383-b9dcbcd5b368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:03.957948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0f809-0128-49c2-b383-b9dcbcd5b368 None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:03.958224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0f809-0128-49c2-b383-b9dcbcd5b368 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:03.958525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0f809-0128-49c2-b383-b9dcbcd5b368 None admin] PATH_INFO: `/v3/system/users/26e4e06acec54b209cb938ce7ba2abce/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:03.960741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0f809-0128-49c2-b383-b9dcbcd5b368 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=26e4e06acec54b209cb938ce7ba2abce, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:03.962361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0f809-0128-49c2-b383-b9dcbcd5b368 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:03.975189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23f7cb-70ce-4556-ae5a-0361d934a7f0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:03.976075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 163/314] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Jun 28 03:04:03 2022] PUT /identity/v3/system/users/26e4e06acec54b209cb938ce7ba2abce/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:04.021640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f3a47-b66b-49b4-a047-f63e543f5ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:04.022939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f3a47-b66b-49b4-a047-f63e543f5ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:04.023352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f3a47-b66b-49b4-a047-f63e543f5ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:04.023783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f3a47-b66b-49b4-a047-f63e543f5ca4 None admin] PATH_INFO: `/v3/users/fb77d2a84f074ea1bad471784a416162` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:04.025218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f3a47-b66b-49b4-a047-f63e543f5ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=fb77d2a84f074ea1bad471784a416162)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:04.026915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f3a47-b66b-49b4-a047-f63e543f5ca4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:04.029449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 152/315] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:04:03 2022] GET /identity/v3/users/fb77d2a84f074ea1bad471784a416162 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:04.037235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0f809-0128-49c2-b383-b9dcbcd5b368 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:04.157636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:04.174043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0f809-0128-49c2-b383-b9dcbcd5b368 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:04.210374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7371d-cf65-4b97-8b24-37e5cf8d2a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:04.211034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7371d-cf65-4b97-8b24-37e5cf8d2a6a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:04.211308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7371d-cf65-4b97-8b24-37e5cf8d2a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:04.211578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7371d-cf65-4b97-8b24-37e5cf8d2a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:04.281421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7371d-cf65-4b97-8b24-37e5cf8d2a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:04.283041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7371d-cf65-4b97-8b24-37e5cf8d2a6a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:04.374119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:04.393761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 164/316] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:04.399545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f3a47-b66b-49b4-a047-f63e543f5ca4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:04.512301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f3a47-b66b-49b4-a047-f63e543f5ca4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:04.550378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce508f-1a92-4789-b841-decbe8109a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:04.551633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce508f-1a92-4789-b841-decbe8109a0f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:04.552100 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce508f-1a92-4789-b841-decbe8109a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:04.552579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce508f-1a92-4789-b841-decbe8109a0f None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:04.553966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce508f-1a92-4789-b841-decbe8109a0f None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:04.555639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce508f-1a92-4789-b841-decbe8109a0f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:04.557905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 153/317] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:04 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:04.563386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7371d-cf65-4b97-8b24-37e5cf8d2a6a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:04.667957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7371d-cf65-4b97-8b24-37e5cf8d2a6a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:04.706419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560887b-f2d8-4f9f-bfae-bf5a4967a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:04.707088 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560887b-f2d8-4f9f-bfae-bf5a4967a30d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:04.707366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560887b-f2d8-4f9f-bfae-bf5a4967a30d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:04.707634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560887b-f2d8-4f9f-bfae-bf5a4967a30d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:04.708465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560887b-f2d8-4f9f-bfae-bf5a4967a30d None admin] RBAC: Adding query filter params (role.id=5c5cdc6f15a846a0829e831d6a8949d4, scope.project.id=fa972b04f73040768b4e81de2c1b8d95, user.id=fb77d2a84f074ea1bad471784a416162) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:04.708772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560887b-f2d8-4f9f-bfae-bf5a4967a30d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:04.710211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560887b-f2d8-4f9f-bfae-bf5a4967a30d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:04.716643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 165/318] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:04 2022] GET /identity/v3/role_assignments?user.id=fb77d2a84f074ea1bad471784a416162&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=5c5cdc6f15a846a0829e831d6a8949d4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:05.376636 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f8458-9844-4b17-8a3f-9f9c56e292f8 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:05.377014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f8458-9844-4b17-8a3f-9f9c56e292f8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:05.377188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f8458-9844-4b17-8a3f-9f9c56e292f8 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:05.378646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 154/319] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:05.383893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52dfc8-f293-4550-b12b-f4b5608b4a7a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:05.384381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52dfc8-f293-4550-b12b-f4b5608b4a7a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:05.384457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52dfc8-f293-4550-b12b-f4b5608b4a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:05.401502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7e52dfc8-f293-4550-b12b-f4b5608b4a7a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:05.402783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7e52dfc8-f293-4550-b12b-f4b5608b4a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:05.427572 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21a9be-97d9-4366-86c9-ec5bfaa31545 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:05.427850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21a9be-97d9-4366-86c9-ec5bfaa31545 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:05.428124 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21a9be-97d9-4366-86c9-ec5bfaa31545 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:05.429505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 155/320] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:04:05.434402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beaee7-f855-44ee-b40c-870886e8c7ea None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:05.434679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beaee7-f855-44ee-b40c-870886e8c7ea None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:05.434958 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beaee7-f855-44ee-b40c-870886e8c7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:05.450922 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:05.451673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-96beaee7-f855-44ee-b40c-870886e8c7ea None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:05.452866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-96beaee7-f855-44ee-b40c-870886e8c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:05.460805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:05.482667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 166/321] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:05.500562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52dfc8-f293-4550-b12b-f4b5608b4a7a None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:05.525355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 156/322] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:05.547370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beaee7-f855-44ee-b40c-870886e8c7ea None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:05.607499 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52dfc8-f293-4550-b12b-f4b5608b4a7a None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:05.644743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5142-f5d4-43cb-811e-940dda45d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:05.645854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5142-f5d4-43cb-811e-940dda45d1fe None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:05.646344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5142-f5d4-43cb-811e-940dda45d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:05.646782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5142-f5d4-43cb-811e-940dda45d1fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:05.648148 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a5142-f5d4-43cb-811e-940dda45d1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:05.649768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a5142-f5d4-43cb-811e-940dda45d1fe None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:05.649889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beaee7-f855-44ee-b40c-870886e8c7ea None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:05.651713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 167/323] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:05.657340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5142-f5d4-43cb-811e-940dda45d1fe None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:05.695463 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2be7-4d35-44a3-9b33-b1021c70a2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:05.696278 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2be7-4d35-44a3-9b33-b1021c70a2bd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:05.696556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2be7-4d35-44a3-9b33-b1021c70a2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:05.696824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2be7-4d35-44a3-9b33-b1021c70a2bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:05.707226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:05.708545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2be7-4d35-44a3-9b33-b1021c70a2bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-e3ec2be7-4d35-44a3-9b33-b1021c70a2bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:05.716456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:05.717355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:05.718138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 157/324] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:05.723821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2be7-4d35-44a3-9b33-b1021c70a2bd None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:05.726974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:05.765959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5142-f5d4-43cb-811e-940dda45d1fe None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:05.800968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57d80f-43ec-4dd3-81e8-34578664764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:05.801792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d80f-43ec-4dd3-81e8-34578664764e None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:05.802069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d80f-43ec-4dd3-81e8-34578664764e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:05.802363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d80f-43ec-4dd3-81e8-34578664764e None admin] PATH_INFO: `/v3/groups` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:05.803053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57d80f-43ec-4dd3-81e8-34578664764e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:05.804499 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57d80f-43ec-4dd3-81e8-34578664764e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:05.820887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 168/325] 10.222.0.23 () {60 vars in 1134 bytes} [Tue Jun 28 03:04:05 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:04:05.834330 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2be7-4d35-44a3-9b33-b1021c70a2bd None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:05.872191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa800746-594a-4217-90de-75db7a321511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:05.872902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800746-594a-4217-90de-75db7a321511 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:05.873185 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800746-594a-4217-90de-75db7a321511 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:05.873461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800746-594a-4217-90de-75db7a321511 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:05.874238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa800746-594a-4217-90de-75db7a321511 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:05.874594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa800746-594a-4217-90de-75db7a321511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:05.876078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa800746-594a-4217-90de-75db7a321511 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:05.890459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 158/326] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:05.891791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57d80f-43ec-4dd3-81e8-34578664764e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:06.005296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57d80f-43ec-4dd3-81e8-34578664764e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:06.012568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:06.042201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6f4ec-c299-4673-adca-8b7f7229ab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:06.045426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6f4ec-c299-4673-adca-8b7f7229ab31 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:06.045426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6f4ec-c299-4673-adca-8b7f7229ab31 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:06.045426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6f4ec-c299-4673-adca-8b7f7229ab31 None admin] PATH_INFO: `/v3/users/1af758ce0642455786b4ec3faadee644` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:06.046561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6f4ec-c299-4673-adca-8b7f7229ab31 None admin] RBAC: Authorizing `identity:get_user(user_id=1af758ce0642455786b4ec3faadee644)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:06.048049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6f4ec-c299-4673-adca-8b7f7229ab31 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:06.049997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 169/327] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:04:05 2022] GET /identity/v3/users/1af758ce0642455786b4ec3faadee644 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:06.055623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa800746-594a-4217-90de-75db7a321511 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:06.088693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080f3fc-38e3-4e54-9164-923606e3d9ee None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:06.089019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080f3fc-38e3-4e54-9164-923606e3d9ee None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:06.089249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080f3fc-38e3-4e54-9164-923606e3d9ee None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:06.090739 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 170/328] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:04:06.096723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25f44f-561c-4008-921d-cafd5fc0956d None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:06.097035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25f44f-561c-4008-921d-cafd5fc0956d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:06.097316 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25f44f-561c-4008-921d-cafd5fc0956d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:06.116042 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8a25f44f-561c-4008-921d-cafd5fc0956d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:06.117234 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8a25f44f-561c-4008-921d-cafd5fc0956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:06.130625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:06.178998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa800746-594a-4217-90de-75db7a321511 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:06.203164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 171/329] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:06.224569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71319b-6a21-4b7d-ad58-3669d10caf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:06.225471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71319b-6a21-4b7d-ad58-3669d10caf82 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:06.225777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71319b-6a21-4b7d-ad58-3669d10caf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:06.226055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71319b-6a21-4b7d-ad58-3669d10caf82 None admin] PATH_INFO: `/v3/system/users/1af758ce0642455786b4ec3faadee644/roles/5c5cdc6f15a846a0829e831d6a8949d4` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:06.227199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25f44f-561c-4008-921d-cafd5fc0956d None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:06.227627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71319b-6a21-4b7d-ad58-3669d10caf82 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1af758ce0642455786b4ec3faadee644, role_id=5c5cdc6f15a846a0829e831d6a8949d4)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:06.229035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71319b-6a21-4b7d-ad58-3669d10caf82 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:06.240121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 159/330] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Jun 28 03:04:06 2022] PUT /identity/v3/system/users/1af758ce0642455786b4ec3faadee644/roles/5c5cdc6f15a846a0829e831d6a8949d4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:06.347349 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25f44f-561c-4008-921d-cafd5fc0956d None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:06.350648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:06.390892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adb583-a69a-4aca-8a2b-f5061ae97b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:06.392941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb583-a69a-4aca-8a2b-f5061ae97b23 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:06.393516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb583-a69a-4aca-8a2b-f5061ae97b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:06.393986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb583-a69a-4aca-8a2b-f5061ae97b23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:06.406772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adb583-a69a-4aca-8a2b-f5061ae97b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-96adb583-a69a-4aca-8a2b-f5061ae97b23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:06.415591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:06.416593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:06.417442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:06.420072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 172/331] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:06.426353 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71319b-6a21-4b7d-ad58-3669d10caf82 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:06.541649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71319b-6a21-4b7d-ad58-3669d10caf82 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:06.574086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:06.584625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2094041-e1b3-49d0-a2a6-ead4b4ee2f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:06.585664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2094041-e1b3-49d0-a2a6-ead4b4ee2f96 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:06.585949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2094041-e1b3-49d0-a2a6-ead4b4ee2f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:06.586228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2094041-e1b3-49d0-a2a6-ead4b4ee2f96 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:06.587021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2094041-e1b3-49d0-a2a6-ead4b4ee2f96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:06.587328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2094041-e1b3-49d0-a2a6-ead4b4ee2f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:06.588777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2094041-e1b3-49d0-a2a6-ead4b4ee2f96 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:06.600856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 160/332] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:06.606247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adb583-a69a-4aca-8a2b-f5061ae97b23 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:06.726413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adb583-a69a-4aca-8a2b-f5061ae97b23 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:06.775526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef9916-3f1c-426a-9616-51156c2a6954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:06.777012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9916-3f1c-426a-9616-51156c2a6954 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:06.777495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9916-3f1c-426a-9616-51156c2a6954 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:06.777920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9916-3f1c-426a-9616-51156c2a6954 None admin] PATH_INFO: `/v3/users/26e4e06acec54b209cb938ce7ba2abce` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:06.779370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef9916-3f1c-426a-9616-51156c2a6954 None admin] RBAC: Authorizing `identity:get_user(user_id=26e4e06acec54b209cb938ce7ba2abce)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:06.781428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef9916-3f1c-426a-9616-51156c2a6954 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:06.784728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 173/333] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:04:06 2022] GET /identity/v3/users/26e4e06acec54b209cb938ce7ba2abce => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:06.791701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2094041-e1b3-49d0-a2a6-ead4b4ee2f96 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:06.900600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2094041-e1b3-49d0-a2a6-ead4b4ee2f96 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:06.936805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40274bc7-0b40-4897-9352-73a950ff46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:06.937478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40274bc7-0b40-4897-9352-73a950ff46fe None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:06.937758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40274bc7-0b40-4897-9352-73a950ff46fe None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:06.938030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40274bc7-0b40-4897-9352-73a950ff46fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:06.939046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40274bc7-0b40-4897-9352-73a950ff46fe None admin] RBAC: Adding query filter params (role.id=86e9a6602f6945d7b87811b8708df6b7, user.id=26e4e06acec54b209cb938ce7ba2abce, scope.system=all) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:06.939392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40274bc7-0b40-4897-9352-73a950ff46fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:06.940849 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40274bc7-0b40-4897-9352-73a950ff46fe None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:06.955151 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 161/334] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Jun 28 03:04:06 2022] GET /identity/v3/role_assignments?user.id=26e4e06acec54b209cb938ce7ba2abce&scope.system=all&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:08.491150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73e7c8-c9a5-40b8-b0ec-aa291300ae51 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:08.491668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73e7c8-c9a5-40b8-b0ec-aa291300ae51 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:08.491668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73e7c8-c9a5-40b8-b0ec-aa291300ae51 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:08.493249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 174/335] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:08.498524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6a2de-699e-4507-8372-7cef512959d2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:08.498967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6a2de-699e-4507-8372-7cef512959d2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:08.499151 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6a2de-699e-4507-8372-7cef512959d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:08.517988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e4d6a2de-699e-4507-8372-7cef512959d2 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:08.519243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e4d6a2de-699e-4507-8372-7cef512959d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:08.577903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:08.606020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 162/336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:08.616574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2bd10-5373-475f-8ceb-6a82cb148fb5 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:08.616846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2bd10-5373-475f-8ceb-6a82cb148fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:08.617122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2bd10-5373-475f-8ceb-6a82cb148fb5 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:08.618812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 175/337] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:08.624067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da1dc-ac74-4764-95e8-7b5f18944cb5 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:08.624353 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da1dc-ac74-4764-95e8-7b5f18944cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:08.624621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da1dc-ac74-4764-95e8-7b5f18944cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:08.641111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2bd10-5373-475f-8ceb-6a82cb148fb5 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:08.647870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a00da1dc-ac74-4764-95e8-7b5f18944cb5 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:08.649315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a00da1dc-ac74-4764-95e8-7b5f18944cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:08.676372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:08.779264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2bd10-5373-475f-8ceb-6a82cb148fb5 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:08.792574 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 163/338] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:08.793961 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba4e6-fd3f-4e65-bbeb-a70454c6aa91 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:08.794249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba4e6-fd3f-4e65-bbeb-a70454c6aa91 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:08.794551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba4e6-fd3f-4e65-bbeb-a70454c6aa91 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:08.803748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 164/339] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:08.809033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b30cd-4860-49fb-899c-531e86a7a54f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:08.809322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b30cd-4860-49fb-899c-531e86a7a54f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:08.809598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b30cd-4860-49fb-899c-531e86a7a54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:08.818953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b7292-ce80-42af-b192-84bf63fa87a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:08.819894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b7292-ce80-42af-b192-84bf63fa87a7 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:08.820192 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b7292-ce80-42af-b192-84bf63fa87a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:08.820458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b7292-ce80-42af-b192-84bf63fa87a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:08.833318 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b7292-ce80-42af-b192-84bf63fa87a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-809b7292-ce80-42af-b192-84bf63fa87a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:08.842075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:08.842956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:08.843741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:08.844326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1e1b30cd-4860-49fb-899c-531e86a7a54f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:08.844397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 176/340] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:04:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:08.844987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1e1b30cd-4860-49fb-899c-531e86a7a54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:08.849372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b7292-ce80-42af-b192-84bf63fa87a7 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:08.956051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b7292-ce80-42af-b192-84bf63fa87a7 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:08.958633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:08.992008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976381a5-8a5c-49f5-a494-ac93198e7e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:08.992700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976381a5-8a5c-49f5-a494-ac93198e7e94 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:08.992977 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976381a5-8a5c-49f5-a494-ac93198e7e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:08.993256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976381a5-8a5c-49f5-a494-ac93198e7e94 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:08.994012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976381a5-8a5c-49f5-a494-ac93198e7e94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:08.994374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976381a5-8a5c-49f5-a494-ac93198e7e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:08.995751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976381a5-8a5c-49f5-a494-ac93198e7e94 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:09.004631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 177/341] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:09.005445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976381a5-8a5c-49f5-a494-ac93198e7e94 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:09.042430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 165/342] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:09.043023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b30cd-4860-49fb-899c-531e86a7a54f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:09.118629 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976381a5-8a5c-49f5-a494-ac93198e7e94 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:09.121122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:09.158756 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79344442-ecfb-49aa-a0a4-52b2722c0090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:09.159664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79344442-ecfb-49aa-a0a4-52b2722c0090 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:09.160106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79344442-ecfb-49aa-a0a4-52b2722c0090 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:09.160549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79344442-ecfb-49aa-a0a4-52b2722c0090 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:09.173369 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79344442-ecfb-49aa-a0a4-52b2722c0090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-79344442-ecfb-49aa-a0a4-52b2722c0090 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:09.181694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:09.182790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 03:04:09.183787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:09.186164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 178/343] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:09.187215 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79344442-ecfb-49aa-a0a4-52b2722c0090 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:09.204306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:09.214762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b30cd-4860-49fb-899c-531e86a7a54f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:09.275004 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da5c00-2732-4d04-90b0-2568b420cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:09.275776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da5c00-2732-4d04-90b0-2568b420cc82 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:09.275961 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da5c00-2732-4d04-90b0-2568b420cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:09.276208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da5c00-2732-4d04-90b0-2568b420cc82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:09.295771 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79344442-ecfb-49aa-a0a4-52b2722c0090 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:09.330887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b46b15-0cc0-45ca-bc60-0c91e10fcaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:09.332050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b46b15-0cc0-45ca-bc60-0c91e10fcaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:09.332526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b46b15-0cc0-45ca-bc60-0c91e10fcaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:09.332967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b46b15-0cc0-45ca-bc60-0c91e10fcaf1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:09.352695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b46b15-0cc0-45ca-bc60-0c91e10fcaf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-e5b46b15-0cc0-45ca-bc60-0c91e10fcaf1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:09.366540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:09.367490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:09.368294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:09.372920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 179/344] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:09.374685 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b46b15-0cc0-45ca-bc60-0c91e10fcaf1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:09.399058 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da5c00-2732-4d04-90b0-2568b420cc82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:09.400809 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da5c00-2732-4d04-90b0-2568b420cc82 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:09.469290 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:09.482641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:09.508789 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b46b15-0cc0-45ca-bc60-0c91e10fcaf1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:09.546748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad16469-8d72-4c52-98e6-a80d4bb3defe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:09.547712 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16469-8d72-4c52-98e6-a80d4bb3defe None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:09.548273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16469-8d72-4c52-98e6-a80d4bb3defe None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:09.548877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad16469-8d72-4c52-98e6-a80d4bb3defe None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:09.550208 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16469-8d72-4c52-98e6-a80d4bb3defe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:09.550678 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16469-8d72-4c52-98e6-a80d4bb3defe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:09.552211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad16469-8d72-4c52-98e6-a80d4bb3defe None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:09.562280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 180/345] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:09.563385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad16469-8d72-4c52-98e6-a80d4bb3defe None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:09.596225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 166/346] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:09.602107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da5c00-2732-4d04-90b0-2568b420cc82 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:09.701226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad16469-8d72-4c52-98e6-a80d4bb3defe None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:09.728673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da5c00-2732-4d04-90b0-2568b420cc82 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:09.747366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071775-7d4b-481d-995d-b587efc83c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:09.748601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071775-7d4b-481d-995d-b587efc83c87 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:09.749056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071775-7d4b-481d-995d-b587efc83c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:09.749498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071775-7d4b-481d-995d-b587efc83c87 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:09.750488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071775-7d4b-481d-995d-b587efc83c87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:09.750955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071775-7d4b-481d-995d-b587efc83c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:09.753464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071775-7d4b-481d-995d-b587efc83c87 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:09.757001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:09.766919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 181/347] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:09.768083 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071775-7d4b-481d-995d-b587efc83c87 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:09.768716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b65a9-0792-4fd9-8590-a50e6086ee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:09.769667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b65a9-0792-4fd9-8590-a50e6086ee99 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:09.770036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b65a9-0792-4fd9-8590-a50e6086ee99 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:09.771232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b65a9-0792-4fd9-8590-a50e6086ee99 None admin] PATH_INFO: `/v3/users/1af758ce0642455786b4ec3faadee644` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:09.773007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b65a9-0792-4fd9-8590-a50e6086ee99 None admin] RBAC: Authorizing `identity:get_user(user_id=1af758ce0642455786b4ec3faadee644)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:09.774686 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b65a9-0792-4fd9-8590-a50e6086ee99 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:09.776780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 167/348] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:04:09 2022] GET /identity/v3/users/1af758ce0642455786b4ec3faadee644 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:09.777629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b65a9-0792-4fd9-8590-a50e6086ee99 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:09.790665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:09.903031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b65a9-0792-4fd9-8590-a50e6086ee99 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:09.910596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071775-7d4b-481d-995d-b587efc83c87 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:09.941652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef09eed-3946-4622-b817-27fbca7c6ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:09.942357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef09eed-3946-4622-b817-27fbca7c6ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:09.942791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef09eed-3946-4622-b817-27fbca7c6ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:09.943073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef09eed-3946-4622-b817-27fbca7c6ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:09.951845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d39c5c-1a28-4039-bc3c-4e7cd5dce39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:09.953173 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d39c5c-1a28-4039-bc3c-4e7cd5dce39a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:09.953458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d39c5c-1a28-4039-bc3c-4e7cd5dce39a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:09.953728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d39c5c-1a28-4039-bc3c-4e7cd5dce39a None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:09.955042 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d39c5c-1a28-4039-bc3c-4e7cd5dce39a None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:09.957605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d39c5c-1a28-4039-bc3c-4e7cd5dce39a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:09.959839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 182/349] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:09 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:09.960606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d39c5c-1a28-4039-bc3c-4e7cd5dce39a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:10.046981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef09eed-3946-4622-b817-27fbca7c6ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:10.050559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef09eed-3946-4622-b817-27fbca7c6ea7 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:10.060263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:10.065101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:10.113749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d39c5c-1a28-4039-bc3c-4e7cd5dce39a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:10.157978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada73044-a455-4826-a099-711c8fa2e489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:10.158774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada73044-a455-4826-a099-711c8fa2e489 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.159068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada73044-a455-4826-a099-711c8fa2e489 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.159340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada73044-a455-4826-a099-711c8fa2e489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.160184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada73044-a455-4826-a099-711c8fa2e489 None admin] RBAC: Adding query filter params (role.id=5c5cdc6f15a846a0829e831d6a8949d4, user.id=1af758ce0642455786b4ec3faadee644, scope.system=all) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:10.160489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada73044-a455-4826-a099-711c8fa2e489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:10.161934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada73044-a455-4826-a099-711c8fa2e489 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:10.182194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 183/350] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Jun 28 03:04:09 2022] GET /identity/v3/role_assignments?user.id=1af758ce0642455786b4ec3faadee644&scope.system=all&role.id=5c5cdc6f15a846a0829e831d6a8949d4 => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:10.182194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afffc6-1a44-4a83-9f14-1a914a288993 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.182194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afffc6-1a44-4a83-9f14-1a914a288993 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.182194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afffc6-1a44-4a83-9f14-1a914a288993 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.182194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 184/351] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:10.182946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afffc6-1a44-4a83-9f14-1a914a288993 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:10.235578 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 168/352] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:10.237052 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc3231-7ec4-48c7-af86-aa1f42ec0edd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.237341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc3231-7ec4-48c7-af86-aa1f42ec0edd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.237617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc3231-7ec4-48c7-af86-aa1f42ec0edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.272051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-50cc3231-7ec4-48c7-af86-aa1f42ec0edd None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:10.273261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-50cc3231-7ec4-48c7-af86-aa1f42ec0edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:10.323471 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afffc6-1a44-4a83-9f14-1a914a288993 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:10.361536 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:10.377501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe2e70-2ce8-435c-9dbf-cc087861c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:10.378852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe2e70-2ce8-435c-9dbf-cc087861c061 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.379333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe2e70-2ce8-435c-9dbf-cc087861c061 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.379786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe2e70-2ce8-435c-9dbf-cc087861c061 None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.386003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 169/353] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:10.386003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc3231-7ec4-48c7-af86-aa1f42ec0edd None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:10.393894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe2e70-2ce8-435c-9dbf-cc087861c061 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:10.395931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe2e70-2ce8-435c-9dbf-cc087861c061 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:10.398018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 185/354] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:10 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:10.400972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3cdc1-fb74-49a1-a7de-2bbc266cd4db None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.401483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3cdc1-fb74-49a1-a7de-2bbc266cd4db None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.401931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3cdc1-fb74-49a1-a7de-2bbc266cd4db None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.404622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 186/355] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:10.413479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6356e-efd7-4324-bb42-3d22f968b34c None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.414154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6356e-efd7-4324-bb42-3d22f968b34c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.414752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6356e-efd7-4324-bb42-3d22f968b34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.443474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-d5f6356e-efd7-4324-bb42-3d22f968b34c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:10.444395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:10.445348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d5f6356e-efd7-4324-bb42-3d22f968b34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:10.529937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 187/356] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:10.531132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6356e-efd7-4324-bb42-3d22f968b34c None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:10.537405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc3231-7ec4-48c7-af86-aa1f42ec0edd None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:10.582917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497b2fc-ce7f-4e7b-8b79-f47d8ce9de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:10.583806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497b2fc-ce7f-4e7b-8b79-f47d8ce9de32 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.584090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497b2fc-ce7f-4e7b-8b79-f47d8ce9de32 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.584678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497b2fc-ce7f-4e7b-8b79-f47d8ce9de32 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.585881 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497b2fc-ce7f-4e7b-8b79-f47d8ce9de32 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:10.587387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497b2fc-ce7f-4e7b-8b79-f47d8ce9de32 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:10.589311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 170/357] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:10 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:10.589896 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497b2fc-ce7f-4e7b-8b79-f47d8ce9de32 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:10.658517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6356e-efd7-4324-bb42-3d22f968b34c None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:10.678024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:10.699354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b382c2-d614-4010-9ade-1517db7a2fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:10.700276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b382c2-d614-4010-9ade-1517db7a2fae None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.702024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b382c2-d614-4010-9ade-1517db7a2fae None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.702616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b382c2-d614-4010-9ade-1517db7a2fae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.703972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b382c2-d614-4010-9ade-1517db7a2fae None admin] RBAC: Adding query filter params (group.id=3f3f3f5ff3f648e692355102f4f2e77a, role.id=66ac9c3671cb46b6ae847fdbc68015b3, scope.project.id=f24f46abed0346909dcf67babae2c4d8) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:10.704346 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b382c2-d614-4010-9ade-1517db7a2fae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:10.705924 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b382c2-d614-4010-9ade-1517db7a2fae None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:10.712034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497b2fc-ce7f-4e7b-8b79-f47d8ce9de32 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:10.712506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 188/358] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Jun 28 03:04:10 2022] GET /identity/v3/role_assignments?group.id=3f3f3f5ff3f648e692355102f4f2e77a&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=66ac9c3671cb46b6ae847fdbc68015b3 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:10.715425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:10.715558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b382c2-d614-4010-9ade-1517db7a2fae None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:10.762850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc0f46-b65a-4ca1-b42d-29863c947bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:10.763672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0f46-b65a-4ca1-b42d-29863c947bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.763951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0f46-b65a-4ca1-b42d-29863c947bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.764223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0f46-b65a-4ca1-b42d-29863c947bb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.781029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc0f46-b65a-4ca1-b42d-29863c947bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b8dc0f46-b65a-4ca1-b42d-29863c947bb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:10.789188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:10.790216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:10.791096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:10.794433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 171/359] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:10.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc0f46-b65a-4ca1-b42d-29863c947bb5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:10.850007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b382c2-d614-4010-9ade-1517db7a2fae None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:10.903239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914725f-9ab7-440b-b4ff-9368571085b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:10.904353 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914725f-9ab7-440b-b4ff-9368571085b4 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.904775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914725f-9ab7-440b-b4ff-9368571085b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.905184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914725f-9ab7-440b-b4ff-9368571085b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.919032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914725f-9ab7-440b-b4ff-9368571085b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:10.920633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc0f46-b65a-4ca1-b42d-29863c947bb5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-9914725f-9ab7-440b-b4ff-9368571085b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:10.930700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:10.933544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 189/360] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:04:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:10.934375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914725f-9ab7-440b-b4ff-9368571085b4 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:10.975787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebacdd-af5e-4b6f-be64-cda2cb71ac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:10.976678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebacdd-af5e-4b6f-be64-cda2cb71ac3c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.976960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebacdd-af5e-4b6f-be64-cda2cb71ac3c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.977234 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebacdd-af5e-4b6f-be64-cda2cb71ac3c None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.978459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebacdd-af5e-4b6f-be64-cda2cb71ac3c None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:10.979920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebacdd-af5e-4b6f-be64-cda2cb71ac3c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:10.981557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 172/361] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:10 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:10.983350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a8b78-4884-4fa7-8995-238cd0a9838a None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:10.983350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a8b78-4884-4fa7-8995-238cd0a9838a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:10.983350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a8b78-4884-4fa7-8995-238cd0a9838a None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:10.989239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 173/362] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:10.989239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a8b78-4884-4fa7-8995-238cd0a9838a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:10.997101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:11.030454 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:11.092125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914725f-9ab7-440b-b4ff-9368571085b4 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:11.112829 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a8b78-4884-4fa7-8995-238cd0a9838a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:11.138723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93fcf2-c546-426a-8270-65b7538c9c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:11.140312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93fcf2-c546-426a-8270-65b7538c9c44 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:11.140873 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93fcf2-c546-426a-8270-65b7538c9c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:11.141489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93fcf2-c546-426a-8270-65b7538c9c44 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:11.142840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93fcf2-c546-426a-8270-65b7538c9c44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:11.143149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93fcf2-c546-426a-8270-65b7538c9c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:11.145270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93fcf2-c546-426a-8270-65b7538c9c44 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:11.153885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc08db8-0599-4b16-9aef-b6bab2cfbf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:11.154710 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc08db8-0599-4b16-9aef-b6bab2cfbf41 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:11.154986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc08db8-0599-4b16-9aef-b6bab2cfbf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:11.155270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc08db8-0599-4b16-9aef-b6bab2cfbf41 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:11.155851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 190/363] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:11.156126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc08db8-0599-4b16-9aef-b6bab2cfbf41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:11.156458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc08db8-0599-4b16-9aef-b6bab2cfbf41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:11.156661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93fcf2-c546-426a-8270-65b7538c9c44 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:11.157940 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc08db8-0599-4b16-9aef-b6bab2cfbf41 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:11.173175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 174/364] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:11.174842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9250bc-4226-43fd-8bab-36c4325680c4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:11.175280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9250bc-4226-43fd-8bab-36c4325680c4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:11.175701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9250bc-4226-43fd-8bab-36c4325680c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:11.199351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5f9250bc-4226-43fd-8bab-36c4325680c4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:11.200890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5f9250bc-4226-43fd-8bab-36c4325680c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:11.294503 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93fcf2-c546-426a-8270-65b7538c9c44 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:11.298374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 175/365] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:11.299311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9250bc-4226-43fd-8bab-36c4325680c4 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:11.299524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:11.328027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:11.341881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b10b-3a24-4303-8686-61481fcaedf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:11.342580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b10b-3a24-4303-8686-61481fcaedf5 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:11.342857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b10b-3a24-4303-8686-61481fcaedf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:11.343124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b10b-3a24-4303-8686-61481fcaedf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:11.346787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704b10b-3a24-4303-8686-61481fcaedf5 None admin] RBAC: Adding query filter params (group.id=3f3f3f5ff3f648e692355102f4f2e77a, role.id=86e9a6602f6945d7b87811b8708df6b7, scope.project.id=f24f46abed0346909dcf67babae2c4d8) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:11.347118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704b10b-3a24-4303-8686-61481fcaedf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:11.349175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704b10b-3a24-4303-8686-61481fcaedf5 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:11.357343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 191/366] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Jun 28 03:04:11 2022] GET /identity/v3/role_assignments?group.id=3f3f3f5ff3f648e692355102f4f2e77a&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:11.359323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b10b-3a24-4303-8686-61481fcaedf5 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:11.418684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9250bc-4226-43fd-8bab-36c4325680c4 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:11.460279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3d461-3678-41a3-8ae8-61ee91881ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:11.461418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3d461-3678-41a3-8ae8-61ee91881ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:11.462017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3d461-3678-41a3-8ae8-61ee91881ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:11.462588 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3d461-3678-41a3-8ae8-61ee91881ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:11.485634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b10b-3a24-4303-8686-61481fcaedf5 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:11.524111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37a3a2-0bb1-4779-b5af-3c7767aa968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:11.524787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37a3a2-0bb1-4779-b5af-3c7767aa968a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:11.525066 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37a3a2-0bb1-4779-b5af-3c7767aa968a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:11.525336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37a3a2-0bb1-4779-b5af-3c7767aa968a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:11.544742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3d461-3678-41a3-8ae8-61ee91881ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:11.548143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3d461-3678-41a3-8ae8-61ee91881ab0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:11.575435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:11.589708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:11.632998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37a3a2-0bb1-4779-b5af-3c7767aa968a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:11.634558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37a3a2-0bb1-4779-b5af-3c7767aa968a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:11.682466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 176/367] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:11.683378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3d461-3678-41a3-8ae8-61ee91881ab0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:11.753517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 192/368] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:11.754921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37a3a2-0bb1-4779-b5af-3c7767aa968a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:11.805823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3d461-3678-41a3-8ae8-61ee91881ab0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:11.841668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:11.851476 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:11.858584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8b579-0eca-4721-9858-9dbf310ba697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:11.859694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8b579-0eca-4721-9858-9dbf310ba697 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:11.860188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8b579-0eca-4721-9858-9dbf310ba697 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:11.860648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8b579-0eca-4721-9858-9dbf310ba697 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:11.875704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8b579-0eca-4721-9858-9dbf310ba697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-9cd8b579-0eca-4721-9858-9dbf310ba697 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:11.884687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:11.885605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:11.886788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:11.889138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 177/369] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:11.890218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8b579-0eca-4721-9858-9dbf310ba697 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:11.900062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37a3a2-0bb1-4779-b5af-3c7767aa968a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:11.950439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ea11f-2af9-4d55-8289-4e95a601d158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:11.951829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ea11f-2af9-4d55-8289-4e95a601d158 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:11.952317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ea11f-2af9-4d55-8289-4e95a601d158 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:11.952768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ea11f-2af9-4d55-8289-4e95a601d158 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:11.954268 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ea11f-2af9-4d55-8289-4e95a601d158 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:11.956106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ea11f-2af9-4d55-8289-4e95a601d158 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:11.958193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 193/370] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:11 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:11.959312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ea11f-2af9-4d55-8289-4e95a601d158 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:12.036997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8b579-0eca-4721-9858-9dbf310ba697 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:12.094979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ea11f-2af9-4d55-8289-4e95a601d158 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:12.102020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f09f4-b4ab-4b1c-a63c-cc0a59997842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:12.103509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f09f4-b4ab-4b1c-a63c-cc0a59997842 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:12.103795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f09f4-b4ab-4b1c-a63c-cc0a59997842 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:12.104070 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f09f4-b4ab-4b1c-a63c-cc0a59997842 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:12.105696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f09f4-b4ab-4b1c-a63c-cc0a59997842 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:12.108101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f09f4-b4ab-4b1c-a63c-cc0a59997842 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:12.111214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 178/371] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:11 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:12.112237 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f09f4-b4ab-4b1c-a63c-cc0a59997842 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:12.134422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17c454-da7e-4138-a88e-0d01793c7903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:12.135111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c454-da7e-4138-a88e-0d01793c7903 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:12.135387 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c454-da7e-4138-a88e-0d01793c7903 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:12.135657 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c454-da7e-4138-a88e-0d01793c7903 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:12.136402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17c454-da7e-4138-a88e-0d01793c7903 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:12.136703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17c454-da7e-4138-a88e-0d01793c7903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:12.138068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17c454-da7e-4138-a88e-0d01793c7903 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:12.140434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:12.150113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 194/372] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:12.150799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17c454-da7e-4138-a88e-0d01793c7903 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:12.198134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:12.250771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f09f4-b4ab-4b1c-a63c-cc0a59997842 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:12.255183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17c454-da7e-4138-a88e-0d01793c7903 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:12.287850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb01baf-7563-4a4f-b927-b7890f9fc963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:12.288656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb01baf-7563-4a4f-b927-b7890f9fc963 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:12.288936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb01baf-7563-4a4f-b927-b7890f9fc963 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:12.289205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb01baf-7563-4a4f-b927-b7890f9fc963 None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:12.290118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9069d2f-9b95-41dc-99a5-190d28812fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:12.290431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb01baf-7563-4a4f-b927-b7890f9fc963 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:12.291139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9069d2f-9b95-41dc-99a5-190d28812fbe None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:12.291479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9069d2f-9b95-41dc-99a5-190d28812fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:12.291810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9069d2f-9b95-41dc-99a5-190d28812fbe None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:12.291927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb01baf-7563-4a4f-b927-b7890f9fc963 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:12.293085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9069d2f-9b95-41dc-99a5-190d28812fbe None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:12.293520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 179/373] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:12 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:12.294617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9069d2f-9b95-41dc-99a5-190d28812fbe None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:12.296377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 195/374] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:12 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:12.297136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb01baf-7563-4a4f-b927-b7890f9fc963 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:12.300913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9069d2f-9b95-41dc-99a5-190d28812fbe None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:12.374697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:12.407793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9069d2f-9b95-41dc-99a5-190d28812fbe None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:12.410205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb01baf-7563-4a4f-b927-b7890f9fc963 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:12.433852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:12.443459 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0e6a7-7df7-4413-801a-a37138ab90c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:12.444133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0e6a7-7df7-4413-801a-a37138ab90c4 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:12.444413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0e6a7-7df7-4413-801a-a37138ab90c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:12.444682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0e6a7-7df7-4413-801a-a37138ab90c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:12.445522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0e6a7-7df7-4413-801a-a37138ab90c4 None admin] RBAC: Adding query filter params (group.id=3f3f3f5ff3f648e692355102f4f2e77a, role.id=86e9a6602f6945d7b87811b8708df6b7, scope.project.id=fa972b04f73040768b4e81de2c1b8d95) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:12.445824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0e6a7-7df7-4413-801a-a37138ab90c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:12.447290 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0e6a7-7df7-4413-801a-a37138ab90c4 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:12.453457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 196/375] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Jun 28 03:04:12 2022] GET /identity/v3/role_assignments?group.id=3f3f3f5ff3f648e692355102f4f2e77a&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:12.454266 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0e6a7-7df7-4413-801a-a37138ab90c4 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:12.460992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac0fa7-dfc2-4fd8-b643-4c563cd159ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:12.461726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0fa7-dfc2-4fd8-b643-4c563cd159ab None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:12.462010 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0fa7-dfc2-4fd8-b643-4c563cd159ab None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:12.462284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0fa7-dfc2-4fd8-b643-4c563cd159ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:12.566129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0e6a7-7df7-4413-801a-a37138ab90c4 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:12.578529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac0fa7-dfc2-4fd8-b643-4c563cd159ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:12.580200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac0fa7-dfc2-4fd8-b643-4c563cd159ab None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:12.603017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46393f8-9105-4c27-a873-11ec1c645c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:12.603677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46393f8-9105-4c27-a873-11ec1c645c8f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:12.603963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46393f8-9105-4c27-a873-11ec1c645c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:12.604244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46393f8-9105-4c27-a873-11ec1c645c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:12.605086 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46393f8-9105-4c27-a873-11ec1c645c8f None admin] RBAC: Adding query filter params (group.id=3f3f3f5ff3f648e692355102f4f2e77a, role.id=66ac9c3671cb46b6ae847fdbc68015b3, scope.project.id=fa972b04f73040768b4e81de2c1b8d95) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:12.605391 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46393f8-9105-4c27-a873-11ec1c645c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:12.607860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46393f8-9105-4c27-a873-11ec1c645c8f None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:12.609996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:12.614785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 197/376] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Jun 28 03:04:12 2022] GET /identity/v3/role_assignments?group.id=3f3f3f5ff3f648e692355102f4f2e77a&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=66ac9c3671cb46b6ae847fdbc68015b3 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:12.737286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 180/377] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:12.743865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46393f8-9105-4c27-a873-11ec1c645c8f None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:12.874750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46393f8-9105-4c27-a873-11ec1c645c8f None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:12.908645 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac96cc-2f6c-4a9f-994b-dcc62e785f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:12.909533 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac96cc-2f6c-4a9f-994b-dcc62e785f6e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:12.909810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac96cc-2f6c-4a9f-994b-dcc62e785f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:12.910082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac96cc-2f6c-4a9f-994b-dcc62e785f6e None admin] PATH_INFO: `/v3/projects/3e3a42e79f984a37804898fa1c77f82d` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:12.911296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac96cc-2f6c-4a9f-994b-dcc62e785f6e None admin] RBAC: Authorizing `identity:get_project(project_id=3e3a42e79f984a37804898fa1c77f82d)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:12.912736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac96cc-2f6c-4a9f-994b-dcc62e785f6e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:12.914759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 198/378] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:12 2022] GET /identity/v3/projects/3e3a42e79f984a37804898fa1c77f82d => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:12.920685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac0fa7-dfc2-4fd8-b643-4c563cd159ab None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:12.948509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:12.993011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a0963-dc4c-4c9d-a493-695667f5fabf None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:12.993327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a0963-dc4c-4c9d-a493-695667f5fabf None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:12.993554 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a0963-dc4c-4c9d-a493-695667f5fabf None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:12.999859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 199/379] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:13.017206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a916f41-bbcc-4c2b-818b-6b8a3884f07d None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:13.022313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a916f41-bbcc-4c2b-818b-6b8a3884f07d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:13.022818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a916f41-bbcc-4c2b-818b-6b8a3884f07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:13.050434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5a916f41-bbcc-4c2b-818b-6b8a3884f07d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:13.052671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5a916f41-bbcc-4c2b-818b-6b8a3884f07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:13.075929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac0fa7-dfc2-4fd8-b643-4c563cd159ab None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:13.125459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94ba30-cc5e-4cad-b99b-30c228ef343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:13.126260 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ba30-cc5e-4cad-b99b-30c228ef343d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:13.126658 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ba30-cc5e-4cad-b99b-30c228ef343d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:13.126933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ba30-cc5e-4cad-b99b-30c228ef343d None admin] PATH_INFO: `/v3/groups/1d2475e67dd9467298c1792daf268230` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:13.136764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94ba30-cc5e-4cad-b99b-30c228ef343d None admin] RBAC: Authorizing `identity:get_group(group_id=1d2475e67dd9467298c1792daf268230)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:13.138241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94ba30-cc5e-4cad-b99b-30c228ef343d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:13.140319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 181/380] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:12 2022] GET /identity/v3/groups/1d2475e67dd9467298c1792daf268230 => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:13.145781 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94ba30-cc5e-4cad-b99b-30c228ef343d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:13.180951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:13.213747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 200/381] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:13.251311 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a916f41-bbcc-4c2b-818b-6b8a3884f07d None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:13.264077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:13.286737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94ba30-cc5e-4cad-b99b-30c228ef343d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:13.324596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4689b-2ea3-404c-a839-9f35e9427f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:13.325270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4689b-2ea3-404c-a839-9f35e9427f0b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:13.325547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4689b-2ea3-404c-a839-9f35e9427f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:13.325815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4689b-2ea3-404c-a839-9f35e9427f0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:13.326769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4689b-2ea3-404c-a839-9f35e9427f0b None admin] RBAC: Adding query filter params (group.id=1d2475e67dd9467298c1792daf268230, role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=3e3a42e79f984a37804898fa1c77f82d) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:13.327073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4689b-2ea3-404c-a839-9f35e9427f0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:13.328567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4689b-2ea3-404c-a839-9f35e9427f0b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:13.335685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 182/382] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Jun 28 03:04:13 2022] GET /identity/v3/role_assignments?group.id=1d2475e67dd9467298c1792daf268230&scope.project.id=3e3a42e79f984a37804898fa1c77f82d&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:13.471463 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a916f41-bbcc-4c2b-818b-6b8a3884f07d None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:13.524798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862ae8b-213f-431a-ae66-e78c32833ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:13.525646 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ae8b-213f-431a-ae66-e78c32833ddc None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:13.525925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ae8b-213f-431a-ae66-e78c32833ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:13.526196 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ae8b-213f-431a-ae66-e78c32833ddc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:13.540968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862ae8b-213f-431a-ae66-e78c32833ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-7862ae8b-213f-431a-ae66-e78c32833ddc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:13.549480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:13.550383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:13.551178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 201/383] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:04:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:13.557141 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4689b-2ea3-404c-a839-9f35e9427f0b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:13.714154 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4689b-2ea3-404c-a839-9f35e9427f0b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:13.755753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727def4a-6c0e-421c-ba60-40ecfc2ffc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:13.756356 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727def4a-6c0e-421c-ba60-40ecfc2ffc26 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:13.756633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727def4a-6c0e-421c-ba60-40ecfc2ffc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:13.756901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727def4a-6c0e-421c-ba60-40ecfc2ffc26 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:13.757650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727def4a-6c0e-421c-ba60-40ecfc2ffc26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:13.757951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727def4a-6c0e-421c-ba60-40ecfc2ffc26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:13.759537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727def4a-6c0e-421c-ba60-40ecfc2ffc26 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:13.770335 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 183/384] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:13.776078 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862ae8b-213f-431a-ae66-e78c32833ddc None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:13.868494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:13.936720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862ae8b-213f-431a-ae66-e78c32833ddc None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:13.969503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d715a5-6cec-452b-ab41-1870f1b7faf2 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:13.970006 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d715a5-6cec-452b-ab41-1870f1b7faf2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:13.970346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d715a5-6cec-452b-ab41-1870f1b7faf2 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:13.974309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 184/385] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:13.979815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2681-8a7f-4583-897e-e77f7bc30e4c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:13.980103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2681-8a7f-4583-897e-e77f7bc30e4c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:13.980374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2681-8a7f-4583-897e-e77f7bc30e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:13.989701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6007688-d704-47d4-9111-6dd0e2708323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:13.990996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6007688-d704-47d4-9111-6dd0e2708323 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:13.991270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6007688-d704-47d4-9111-6dd0e2708323 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:13.991536 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6007688-d704-47d4-9111-6dd0e2708323 None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:13.993779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6007688-d704-47d4-9111-6dd0e2708323 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:13.995266 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6007688-d704-47d4-9111-6dd0e2708323 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:13.997286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 202/386] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:13 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:14.003747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6007688-d704-47d4-9111-6dd0e2708323 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:14.007842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-dada2681-8a7f-4583-897e-e77f7bc30e4c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:14.008984 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-dada2681-8a7f-4583-897e-e77f7bc30e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:14.021481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:14.120690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 185/387] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:14.188659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6007688-d704-47d4-9111-6dd0e2708323 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:14.192951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada2681-8a7f-4583-897e-e77f7bc30e4c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:14.215597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:14.232313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721cc41-745d-4b72-bd7b-1a787cc964dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:14.234099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721cc41-745d-4b72-bd7b-1a787cc964dd None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:14.234610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721cc41-745d-4b72-bd7b-1a787cc964dd None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:14.235075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721cc41-745d-4b72-bd7b-1a787cc964dd None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:14.237676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721cc41-745d-4b72-bd7b-1a787cc964dd None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:14.239560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721cc41-745d-4b72-bd7b-1a787cc964dd None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:14.242410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 203/388] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:14 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:14.249296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721cc41-745d-4b72-bd7b-1a787cc964dd None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:14.378439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada2681-8a7f-4583-897e-e77f7bc30e4c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:14.384121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721cc41-745d-4b72-bd7b-1a787cc964dd None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:14.417924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd93f-7fe9-4030-82cd-89c3a37928d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:14.418795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd93f-7fe9-4030-82cd-89c3a37928d3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:14.419075 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd93f-7fe9-4030-82cd-89c3a37928d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:14.419348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd93f-7fe9-4030-82cd-89c3a37928d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:14.427111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da7714-2750-4e58-94fa-bf0d158ab285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:14.428714 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:14.429639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da7714-2750-4e58-94fa-bf0d158ab285 None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:14.430083 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da7714-2750-4e58-94fa-bf0d158ab285 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:14.430550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da7714-2750-4e58-94fa-bf0d158ab285 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8/groups/3f3f3f5ff3f648e692355102f4f2e77a/roles/66ac9c3671cb46b6ae847fdbc68015b3` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:14.431707 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cd93f-7fe9-4030-82cd-89c3a37928d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:14.433627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da7714-2750-4e58-94fa-bf0d158ab285 None admin] RBAC: Authorizing `identity:create_grant(project_id=f24f46abed0346909dcf67babae2c4d8, group_id=3f3f3f5ff3f648e692355102f4f2e77a, role_id=66ac9c3671cb46b6ae847fdbc68015b3)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:14.435399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da7714-2750-4e58-94fa-bf0d158ab285 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-070cd93f-7fe9-4030-82cd-89c3a37928d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:14.441811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:14.443036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:14.444040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:14.447042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 186/389] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:14.453701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd93f-7fe9-4030-82cd-89c3a37928d3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:14.461903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 204/390] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Jun 28 03:04:14 2022] PUT /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8/groups/3f3f3f5ff3f648e692355102f4f2e77a/roles/66ac9c3671cb46b6ae847fdbc68015b3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:14.585161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd93f-7fe9-4030-82cd-89c3a37928d3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:14.634893 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdef2c-a1aa-4739-bcb3-0da07b7d7731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:14.635517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdef2c-a1aa-4739-bcb3-0da07b7d7731 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:14.635798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdef2c-a1aa-4739-bcb3-0da07b7d7731 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:14.636088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdef2c-a1aa-4739-bcb3-0da07b7d7731 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:14.636851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdef2c-a1aa-4739-bcb3-0da07b7d7731 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:14.637162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdef2c-a1aa-4739-bcb3-0da07b7d7731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:14.638657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdef2c-a1aa-4739-bcb3-0da07b7d7731 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:14.649876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 187/391] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:14.655488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da7714-2750-4e58-94fa-bf0d158ab285 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:14.748848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:14.821573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da7714-2750-4e58-94fa-bf0d158ab285 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:14.875151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aa9a3-8633-4929-b1e9-27b98e51cbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:14.876032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aa9a3-8633-4929-b1e9-27b98e51cbea None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:14.876370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aa9a3-8633-4929-b1e9-27b98e51cbea None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:14.877286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aa9a3-8633-4929-b1e9-27b98e51cbea None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:14.883031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8aa9a3-8633-4929-b1e9-27b98e51cbea None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:14.884486 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8aa9a3-8633-4929-b1e9-27b98e51cbea None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:14.886608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 205/392] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:14 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:14.895516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdef2c-a1aa-4739-bcb3-0da07b7d7731 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:14.985519 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:15.035926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdef2c-a1aa-4739-bcb3-0da07b7d7731 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:15.105764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb1d8a-631d-48ff-ac9b-a4cf922a9074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:15.106690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1d8a-631d-48ff-ac9b-a4cf922a9074 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:15.106976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1d8a-631d-48ff-ac9b-a4cf922a9074 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:15.107250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1d8a-631d-48ff-ac9b-a4cf922a9074 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:15.108564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb1d8a-631d-48ff-ac9b-a4cf922a9074 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:15.110042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb1d8a-631d-48ff-ac9b-a4cf922a9074 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:15.112244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 188/393] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:14 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:15.118253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aa9a3-8633-4929-b1e9-27b98e51cbea None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:15.242537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aa9a3-8633-4929-b1e9-27b98e51cbea None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:15.263359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:15.283979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a20c9-5733-4294-9988-369903a302cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:15.284897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a20c9-5733-4294-9988-369903a302cc None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:15.285176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a20c9-5733-4294-9988-369903a302cc None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:15.285447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a20c9-5733-4294-9988-369903a302cc None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8/groups/3f3f3f5ff3f648e692355102f4f2e77a/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:15.287537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a20c9-5733-4294-9988-369903a302cc None admin] RBAC: Authorizing `identity:create_grant(project_id=f24f46abed0346909dcf67babae2c4d8, group_id=3f3f3f5ff3f648e692355102f4f2e77a, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:15.288994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a20c9-5733-4294-9988-369903a302cc None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:15.309040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 206/394] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Jun 28 03:04:15 2022] PUT /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8/groups/3f3f3f5ff3f648e692355102f4f2e77a/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:15.460287 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc01dcf-222e-4f96-a9be-c20ee9e77b29 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:15.460801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc01dcf-222e-4f96-a9be-c20ee9e77b29 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:15.461178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc01dcf-222e-4f96-a9be-c20ee9e77b29 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:15.462930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 189/395] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:15.468121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d1c63-b9de-457a-8d73-839c3935ac2b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:15.468410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d1c63-b9de-457a-8d73-839c3935ac2b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:15.468692 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d1c63-b9de-457a-8d73-839c3935ac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:15.492220 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-642d1c63-b9de-457a-8d73-839c3935ac2b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:15.493569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-642d1c63-b9de-457a-8d73-839c3935ac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:15.579826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 207/396] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:15.604097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc01dcf-222e-4f96-a9be-c20ee9e77b29 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:15.713080 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86ec3-10e9-4f5a-901f-932ed23c1f7d None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:15.713413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86ec3-10e9-4f5a-901f-932ed23c1f7d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:15.713630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86ec3-10e9-4f5a-901f-932ed23c1f7d None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:15.715057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 208/397] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:04:15.728856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc01dcf-222e-4f96-a9be-c20ee9e77b29 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:15.729416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402481b-5fa1-40ee-a748-909dd080d144 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:15.729705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402481b-5fa1-40ee-a748-909dd080d144 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:15.729980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402481b-5fa1-40ee-a748-909dd080d144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:15.766364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6343ee-7700-43dd-89f6-f582cf2b219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:15.767210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6343ee-7700-43dd-89f6-f582cf2b219b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:15.767504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6343ee-7700-43dd-89f6-f582cf2b219b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:15.767784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6343ee-7700-43dd-89f6-f582cf2b219b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:15.769334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5402481b-5fa1-40ee-a748-909dd080d144 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:15.769806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:15.770540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5402481b-5fa1-40ee-a748-909dd080d144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:15.781137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6343ee-7700-43dd-89f6-f582cf2b219b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-bb6343ee-7700-43dd-89f6-f582cf2b219b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:15.795410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:15.796328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:15.797112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:15.799484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 190/398] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:15.804637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6343ee-7700-43dd-89f6-f582cf2b219b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:15.916010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 209/399] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:15.936724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6343ee-7700-43dd-89f6-f582cf2b219b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:15.972009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402481b-5fa1-40ee-a748-909dd080d144 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:15.982278 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d13b-fba3-44a8-8ce3-27468ab90307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:15.982991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d13b-fba3-44a8-8ce3-27468ab90307 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:15.983273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d13b-fba3-44a8-8ce3-27468ab90307 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:15.983551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d13b-fba3-44a8-8ce3-27468ab90307 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:15.984372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968d13b-fba3-44a8-8ce3-27468ab90307 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:15.984687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968d13b-fba3-44a8-8ce3-27468ab90307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:15.986224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968d13b-fba3-44a8-8ce3-27468ab90307 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:15.996511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 191/400] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:16.001977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d13b-fba3-44a8-8ce3-27468ab90307 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:16.025728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:16.069982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:16.116496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402481b-5fa1-40ee-a748-909dd080d144 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:16.135670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d13b-fba3-44a8-8ce3-27468ab90307 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:16.159378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ef703-2067-4a55-ac90-032384fe4317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:16.160563 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ef703-2067-4a55-ac90-032384fe4317 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:16.161095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ef703-2067-4a55-ac90-032384fe4317 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:16.161566 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ef703-2067-4a55-ac90-032384fe4317 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:16.172455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ef703-2067-4a55-ac90-032384fe4317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:16.176457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbed1e1-a8c4-4b5a-ac96-11e1d739f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:16.177405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed1e1-a8c4-4b5a-ac96-11e1d739f387 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:16.177758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed1e1-a8c4-4b5a-ac96-11e1d739f387 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:16.178103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed1e1-a8c4-4b5a-ac96-11e1d739f387 None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:16.179388 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbed1e1-a8c4-4b5a-ac96-11e1d739f387 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:16.180922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbed1e1-a8c4-4b5a-ac96-11e1d739f387 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:16.186325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 192/401] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:16 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:16.186325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adad231-2b2a-4f84-bbad-cdff60257d6d None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:16.186325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adad231-2b2a-4f84-bbad-cdff60257d6d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:16.186325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adad231-2b2a-4f84-bbad-cdff60257d6d None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:16.186325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 193/402] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-9a6ef703-2067-4a55-ac90-032384fe4317 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:16.187684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:16.188529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:16.190036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:16.192294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 210/403] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:04:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:16.194218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192abab6-9e89-41e2-9cc7-97a9182d993c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:16.194489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ef703-2067-4a55-ac90-032384fe4317 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:16.194744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192abab6-9e89-41e2-9cc7-97a9182d993c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:16.195148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192abab6-9e89-41e2-9cc7-97a9182d993c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:16.215317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-192abab6-9e89-41e2-9cc7-97a9182d993c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:16.216739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-192abab6-9e89-41e2-9cc7-97a9182d993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:16.294118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 194/404] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:16.295258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192abab6-9e89-41e2-9cc7-97a9182d993c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:16.334986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:16.344270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ef703-2067-4a55-ac90-032384fe4317 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:16.363086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:16.391665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8a41d-d820-49ab-bb0a-78e4f9041a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:16.392632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8a41d-d820-49ab-bb0a-78e4f9041a09 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:16.392916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8a41d-d820-49ab-bb0a-78e4f9041a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:16.393193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8a41d-d820-49ab-bb0a-78e4f9041a09 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:16.394448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8a41d-d820-49ab-bb0a-78e4f9041a09 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:16.396456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8a41d-d820-49ab-bb0a-78e4f9041a09 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:16.403098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 211/405] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:16 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:16.403098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8a41d-d820-49ab-bb0a-78e4f9041a09 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:16.431076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192abab6-9e89-41e2-9cc7-97a9182d993c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:16.477965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1d99e-7909-4bd5-a8cf-9efa29a91e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:16.479261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1d99e-7909-4bd5-a8cf-9efa29a91e9e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:16.479554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1d99e-7909-4bd5-a8cf-9efa29a91e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:16.479832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1d99e-7909-4bd5-a8cf-9efa29a91e9e None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:16.480595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1d99e-7909-4bd5-a8cf-9efa29a91e9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:16.481164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1d99e-7909-4bd5-a8cf-9efa29a91e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:16.482832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1d99e-7909-4bd5-a8cf-9efa29a91e9e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:16.498448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 195/406] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:16.499603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1d99e-7909-4bd5-a8cf-9efa29a91e9e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:16.523469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8a41d-d820-49ab-bb0a-78e4f9041a09 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:16.562641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1409d96-9395-4a0d-a804-0916e1bb1a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:16.563464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1409d96-9395-4a0d-a804-0916e1bb1a95 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:16.563662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1409d96-9395-4a0d-a804-0916e1bb1a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:16.564031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1409d96-9395-4a0d-a804-0916e1bb1a95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:16.577536 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1409d96-9395-4a0d-a804-0916e1bb1a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-f1409d96-9395-4a0d-a804-0916e1bb1a95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:16.585763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:16.586672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:16.587482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:16.590591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 212/407] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:16.591642 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1409d96-9395-4a0d-a804-0916e1bb1a95 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:16.621930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:16.638727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1d99e-7909-4bd5-a8cf-9efa29a91e9e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:16.658060 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:16.688205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d965e8-b5e5-429f-9eed-796f1c7ae181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:16.689889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d965e8-b5e5-429f-9eed-796f1c7ae181 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:16.690444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d965e8-b5e5-429f-9eed-796f1c7ae181 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:16.690923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d965e8-b5e5-429f-9eed-796f1c7ae181 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95/groups/3f3f3f5ff3f648e692355102f4f2e77a/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:16.694334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d965e8-b5e5-429f-9eed-796f1c7ae181 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa972b04f73040768b4e81de2c1b8d95, group_id=3f3f3f5ff3f648e692355102f4f2e77a, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:16.696876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d965e8-b5e5-429f-9eed-796f1c7ae181 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:16.713975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1409d96-9395-4a0d-a804-0916e1bb1a95 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:16.722328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 196/408] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Jun 28 03:04:16 2022] PUT /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95/groups/3f3f3f5ff3f648e692355102f4f2e77a/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:16.722328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d965e8-b5e5-429f-9eed-796f1c7ae181 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:16.793028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae92dd3-5631-40dc-8648-02f466496220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:16.793924 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92dd3-5631-40dc-8648-02f466496220 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:16.794201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92dd3-5631-40dc-8648-02f466496220 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:16.799363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92dd3-5631-40dc-8648-02f466496220 None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:16.800799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae92dd3-5631-40dc-8648-02f466496220 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:16.802306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae92dd3-5631-40dc-8648-02f466496220 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:16.804268 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 213/409] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:16 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:16.815455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae92dd3-5631-40dc-8648-02f466496220 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:16.882796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d965e8-b5e5-429f-9eed-796f1c7ae181 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:16.924507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269687f-b315-4b83-bc39-75aa48bf5e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:16.925624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269687f-b315-4b83-bc39-75aa48bf5e81 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:16.926114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269687f-b315-4b83-bc39-75aa48bf5e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:16.926670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269687f-b315-4b83-bc39-75aa48bf5e81 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:16.927629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269687f-b315-4b83-bc39-75aa48bf5e81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:16.928189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269687f-b315-4b83-bc39-75aa48bf5e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:16.930491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269687f-b315-4b83-bc39-75aa48bf5e81 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:16.943622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 197/410] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:16.948775 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269687f-b315-4b83-bc39-75aa48bf5e81 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:17.001319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:17.007687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:17.018810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae92dd3-5631-40dc-8648-02f466496220 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:17.064833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbca7b-2ed1-4ffe-9461-b3e73b116042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:17.069361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbca7b-2ed1-4ffe-9461-b3e73b116042 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:17.069618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbca7b-2ed1-4ffe-9461-b3e73b116042 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:17.069894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbca7b-2ed1-4ffe-9461-b3e73b116042 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:17.071709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbca7b-2ed1-4ffe-9461-b3e73b116042 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:17.073478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbca7b-2ed1-4ffe-9461-b3e73b116042 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:17.079454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 214/411] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:16 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:17.079454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e960bf9-46a0-4ad8-a030-ee28949c5cdb None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:17.079454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e960bf9-46a0-4ad8-a030-ee28949c5cdb None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:17.079454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e960bf9-46a0-4ad8-a030-ee28949c5cdb None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:17.079454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 215/412] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:17.084896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46010f86-48de-4b28-a9d1-4f86e3c83f46 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:17.085185 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46010f86-48de-4b28-a9d1-4f86e3c83f46 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:17.085453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46010f86-48de-4b28-a9d1-4f86e3c83f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:17.101738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269687f-b315-4b83-bc39-75aa48bf5e81 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:17.106534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-46010f86-48de-4b28-a9d1-4f86e3c83f46 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:17.107730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-46010f86-48de-4b28-a9d1-4f86e3c83f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:17.139706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf1116-6de5-4eb0-84f5-5901553e4784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:17.140978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1116-6de5-4eb0-84f5-5901553e4784 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:17.141457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1116-6de5-4eb0-84f5-5901553e4784 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:17.142027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1116-6de5-4eb0-84f5-5901553e4784 None admin] PATH_INFO: `/v3/groups/1d2475e67dd9467298c1792daf268230` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:17.143519 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf1116-6de5-4eb0-84f5-5901553e4784 None admin] RBAC: Authorizing `identity:get_group(group_id=1d2475e67dd9467298c1792daf268230)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:17.145236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf1116-6de5-4eb0-84f5-5901553e4784 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:17.147786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 198/413] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:16 2022] GET /identity/v3/groups/1d2475e67dd9467298c1792daf268230 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:17.148937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf1116-6de5-4eb0-84f5-5901553e4784 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:17.202436 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 216/414] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:17.204515 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46010f86-48de-4b28-a9d1-4f86e3c83f46 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:17.280399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf1116-6de5-4eb0-84f5-5901553e4784 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:17.281976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:17.324296 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a32004-59b3-49cc-9bed-6ff09387782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:17.325535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a32004-59b3-49cc-9bed-6ff09387782f None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:17.326012 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a32004-59b3-49cc-9bed-6ff09387782f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:17.326498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a32004-59b3-49cc-9bed-6ff09387782f None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95/groups/3f3f3f5ff3f648e692355102f4f2e77a/roles/66ac9c3671cb46b6ae847fdbc68015b3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:17.328937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a32004-59b3-49cc-9bed-6ff09387782f None admin] RBAC: Authorizing `identity:create_grant(project_id=fa972b04f73040768b4e81de2c1b8d95, group_id=3f3f3f5ff3f648e692355102f4f2e77a, role_id=66ac9c3671cb46b6ae847fdbc68015b3)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:17.330768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a32004-59b3-49cc-9bed-6ff09387782f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:17.333701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:17.346737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46010f86-48de-4b28-a9d1-4f86e3c83f46 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:17.350371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 199/415] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Jun 28 03:04:17 2022] PUT /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95/groups/3f3f3f5ff3f648e692355102f4f2e77a/roles/66ac9c3671cb46b6ae847fdbc68015b3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:17.351517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a32004-59b3-49cc-9bed-6ff09387782f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:17.428140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2032-30ca-48b6-bb6b-3bb0c5dba1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:17.430443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2032-30ca-48b6-bb6b-3bb0c5dba1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:17.431628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2032-30ca-48b6-bb6b-3bb0c5dba1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:17.433457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2032-30ca-48b6-bb6b-3bb0c5dba1c8 None admin] PATH_INFO: `/v3/projects/3e3a42e79f984a37804898fa1c77f82d` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:17.435387 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2032-30ca-48b6-bb6b-3bb0c5dba1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=3e3a42e79f984a37804898fa1c77f82d)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:17.437589 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2032-30ca-48b6-bb6b-3bb0c5dba1c8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:17.440467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 217/416] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:17 2022] GET /identity/v3/projects/3e3a42e79f984a37804898fa1c77f82d => generated 344 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:17.446674 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2032-30ca-48b6-bb6b-3bb0c5dba1c8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:17.570937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a32004-59b3-49cc-9bed-6ff09387782f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:17.614244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff9577-46f1-432f-b424-c434a0f5731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:17.615396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff9577-46f1-432f-b424-c434a0f5731d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:17.615860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff9577-46f1-432f-b424-c434a0f5731d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:17.616898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff9577-46f1-432f-b424-c434a0f5731d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:17.626764 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2032-30ca-48b6-bb6b-3bb0c5dba1c8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:17.628425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff9577-46f1-432f-b424-c434a0f5731d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-11ff9577-46f1-432f-b424-c434a0f5731d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:17.638233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:17.639180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:17.639986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 200/417] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:04:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:17.648282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff9577-46f1-432f-b424-c434a0f5731d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:17.686202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:17.706741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55600b7b-525a-4156-9165-3c2da93349e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:17.706741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600b7b-525a-4156-9165-3c2da93349e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:17.706741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600b7b-525a-4156-9165-3c2da93349e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:17.706741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600b7b-525a-4156-9165-3c2da93349e0 None admin] PATH_INFO: `/v3/projects/3e3a42e79f984a37804898fa1c77f82d/groups/1d2475e67dd9467298c1792daf268230/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:17.707106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55600b7b-525a-4156-9165-3c2da93349e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e3a42e79f984a37804898fa1c77f82d, group_id=1d2475e67dd9467298c1792daf268230, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:17.707881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55600b7b-525a-4156-9165-3c2da93349e0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:17.726939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 218/418] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Jun 28 03:04:17 2022] PUT /identity/v3/projects/3e3a42e79f984a37804898fa1c77f82d/groups/1d2475e67dd9467298c1792daf268230/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:17.728626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3898dc9-73e8-4547-b884-b939ac1eb0b2 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:17.729111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3898dc9-73e8-4547-b884-b939ac1eb0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:17.729578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3898dc9-73e8-4547-b884-b939ac1eb0b2 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:17.731251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 219/419] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:17.739948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5279-6beb-49be-80fa-e33addfc6e79 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:17.740956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5279-6beb-49be-80fa-e33addfc6e79 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:17.741422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5279-6beb-49be-80fa-e33addfc6e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:17.786766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-4a5a5279-6beb-49be-80fa-e33addfc6e79 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:17.788411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-4a5a5279-6beb-49be-80fa-e33addfc6e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:17.790011 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff9577-46f1-432f-b424-c434a0f5731d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:17.817360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:17.838736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90a95-4d2d-4411-b785-f97095aa06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:17.839587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90a95-4d2d-4411-b785-f97095aa06e6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:17.839993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90a95-4d2d-4411-b785-f97095aa06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:17.840268 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90a95-4d2d-4411-b785-f97095aa06e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:17.841328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90a95-4d2d-4411-b785-f97095aa06e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:17.841641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90a95-4d2d-4411-b785-f97095aa06e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:17.843562 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90a95-4d2d-4411-b785-f97095aa06e6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:17.854218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 201/420] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:17.859515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90a95-4d2d-4411-b785-f97095aa06e6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:17.941057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 220/421] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:17.963973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:17.965029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5279-6beb-49be-80fa-e33addfc6e79 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:17.985451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90a95-4d2d-4411-b785-f97095aa06e6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:18.032173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431d450-2f1b-48ee-9540-776403bf3206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:18.033614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431d450-2f1b-48ee-9540-776403bf3206 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:18.033614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431d450-2f1b-48ee-9540-776403bf3206 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:18.033952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431d450-2f1b-48ee-9540-776403bf3206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:18.109798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5279-6beb-49be-80fa-e33addfc6e79 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:18.168656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431d450-2f1b-48ee-9540-776403bf3206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:18.170141 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431d450-2f1b-48ee-9540-776403bf3206 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:18.179034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10567d1-3463-4fbc-bfba-a8877041fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:18.180154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10567d1-3463-4fbc-bfba-a8877041fc12 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:18.180601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10567d1-3463-4fbc-bfba-a8877041fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:18.181032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10567d1-3463-4fbc-bfba-a8877041fc12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:18.194477 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10567d1-3463-4fbc-bfba-a8877041fc12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-d10567d1-3463-4fbc-bfba-a8877041fc12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:18.203703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:18.204827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:18.206054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:18.208348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 221/422] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:18.215749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10567d1-3463-4fbc-bfba-a8877041fc12 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:18.229965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:18.328411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10567d1-3463-4fbc-bfba-a8877041fc12 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:18.365391 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c6036-8c06-4418-9b1b-be8fb0b4ca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:18.366722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c6036-8c06-4418-9b1b-be8fb0b4ca4e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:18.367134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c6036-8c06-4418-9b1b-be8fb0b4ca4e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:18.367539 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c6036-8c06-4418-9b1b-be8fb0b4ca4e None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:18.368482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c6036-8c06-4418-9b1b-be8fb0b4ca4e None admin] RBAC: Adding query filter params (name=member) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:18.369049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c6036-8c06-4418-9b1b-be8fb0b4ca4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:18.370661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c6036-8c06-4418-9b1b-be8fb0b4ca4e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:18.384918 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 222/423] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:18.386441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c6036-8c06-4418-9b1b-be8fb0b4ca4e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:18.399845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:18.429313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 202/424] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 03:04:18.434416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431d450-2f1b-48ee-9540-776403bf3206 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:18.468248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:18.493480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c6036-8c06-4418-9b1b-be8fb0b4ca4e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:18.528769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd7f36-161c-4c1c-a8ac-1b302cce8f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:18.529789 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7f36-161c-4c1c-a8ac-1b302cce8f45 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:18.530261 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7f36-161c-4c1c-a8ac-1b302cce8f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:18.530780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7f36-161c-4c1c-a8ac-1b302cce8f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:18.605000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd7f36-161c-4c1c-a8ac-1b302cce8f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:18.608235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd7f36-161c-4c1c-a8ac-1b302cce8f45 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:18.633660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431d450-2f1b-48ee-9540-776403bf3206 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:18.673428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b91c5-f2fa-419c-9aa0-770a104b52b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:18.676287 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b91c5-f2fa-419c-9aa0-770a104b52b9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:18.676822 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b91c5-f2fa-419c-9aa0-770a104b52b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:18.677290 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b91c5-f2fa-419c-9aa0-770a104b52b9 None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:18.679487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b91c5-f2fa-419c-9aa0-770a104b52b9 None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:18.681433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b91c5-f2fa-419c-9aa0-770a104b52b9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:18.684337 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 203/425] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:18 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:18.689982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b91c5-f2fa-419c-9aa0-770a104b52b9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:18.775423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:18.802555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:18.829181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b91c5-f2fa-419c-9aa0-770a104b52b9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:18.861522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 223/426] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 03:04:18.871253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd7f36-161c-4c1c-a8ac-1b302cce8f45 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:18.886965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd89ba-94a2-43ed-ba1f-5ec6e1c0e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:18.888244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd89ba-94a2-43ed-ba1f-5ec6e1c0e674 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:18.888619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd89ba-94a2-43ed-ba1f-5ec6e1c0e674 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:18.888967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd89ba-94a2-43ed-ba1f-5ec6e1c0e674 None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:18.890382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd89ba-94a2-43ed-ba1f-5ec6e1c0e674 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:18.892093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd89ba-94a2-43ed-ba1f-5ec6e1c0e674 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:18.894505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 204/427] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:18 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:18.903283 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd89ba-94a2-43ed-ba1f-5ec6e1c0e674 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:19.042762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd7f36-161c-4c1c-a8ac-1b302cce8f45 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:19.088197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eca7b-3865-4b36-bb50-3227055ee61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:19.091100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eca7b-3865-4b36-bb50-3227055ee61c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:19.091394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eca7b-3865-4b36-bb50-3227055ee61c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:19.091671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eca7b-3865-4b36-bb50-3227055ee61c None admin] PATH_INFO: `/v3/projects/f24f46abed0346909dcf67babae2c4d8` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:19.094267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd89ba-94a2-43ed-ba1f-5ec6e1c0e674 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:19.096478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eca7b-3865-4b36-bb50-3227055ee61c None admin] RBAC: Authorizing `identity:get_project(project_id=f24f46abed0346909dcf67babae2c4d8)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:19.097961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eca7b-3865-4b36-bb50-3227055ee61c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:19.101371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 224/428] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:18 2022] GET /identity/v3/projects/f24f46abed0346909dcf67babae2c4d8 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:19.102872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9604-6ff2-45f1-9db2-a834101a6bf6 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:19.103162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9604-6ff2-45f1-9db2-a834101a6bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:19.103439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9604-6ff2-45f1-9db2-a834101a6bf6 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:19.104698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 225/429] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:19.105462 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de9604-6ff2-45f1-9db2-a834101a6bf6 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:19.124892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:19.143577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6937-5080-478a-8fed-e45bb8750a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:19.144603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6937-5080-478a-8fed-e45bb8750a11 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:19.145076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6937-5080-478a-8fed-e45bb8750a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:19.145553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6937-5080-478a-8fed-e45bb8750a11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:19.146871 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6937-5080-478a-8fed-e45bb8750a11 None admin] RBAC: Adding query filter params (group.id=3f3f3f5ff3f648e692355102f4f2e77a, role.id=66ac9c3671cb46b6ae847fdbc68015b3, scope.project.id=f24f46abed0346909dcf67babae2c4d8) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:19.148321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6937-5080-478a-8fed-e45bb8750a11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:19.149992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6937-5080-478a-8fed-e45bb8750a11 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:19.153904 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:19.163130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 205/430] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Jun 28 03:04:18 2022] GET /identity/v3/role_assignments?group.id=3f3f3f5ff3f648e692355102f4f2e77a&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=66ac9c3671cb46b6ae847fdbc68015b3 => generated 611 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:19.165057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2daa73-2e35-4fe0-9673-e6908bd4ef6e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:19.165561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2daa73-2e35-4fe0-9673-e6908bd4ef6e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:19.166062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2daa73-2e35-4fe0-9673-e6908bd4ef6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:19.186150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1c2daa73-2e35-4fe0-9673-e6908bd4ef6e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:19.188373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1c2daa73-2e35-4fe0-9673-e6908bd4ef6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:19.272297 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 206/431] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:19.299241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2daa73-2e35-4fe0-9673-e6908bd4ef6e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:19.307008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de9604-6ff2-45f1-9db2-a834101a6bf6 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:19.391843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae50a9-f601-428e-a486-a95278e1f4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:19.392820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae50a9-f601-428e-a486-a95278e1f4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:19.393106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae50a9-f601-428e-a486-a95278e1f4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:19.393378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae50a9-f601-428e-a486-a95278e1f4c8 None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:19.399177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae50a9-f601-428e-a486-a95278e1f4c8 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:19.400664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae50a9-f601-428e-a486-a95278e1f4c8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:19.402806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 226/432] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:19 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:19.408565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae50a9-f601-428e-a486-a95278e1f4c8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:19.420437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2daa73-2e35-4fe0-9673-e6908bd4ef6e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:19.437954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:19.465245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f40a6-d8e8-485b-9acb-94bdb60adc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:19.467559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f40a6-d8e8-485b-9acb-94bdb60adc8a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:19.468045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f40a6-d8e8-485b-9acb-94bdb60adc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:19.468511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f40a6-d8e8-485b-9acb-94bdb60adc8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:19.481917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f40a6-d8e8-485b-9acb-94bdb60adc8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-574f40a6-d8e8-485b-9acb-94bdb60adc8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:19.491897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:19.492780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 03:04:19.493595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:19.499061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 207/433] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:19.502840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f40a6-d8e8-485b-9acb-94bdb60adc8a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:19.562794 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae50a9-f601-428e-a486-a95278e1f4c8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:19.574827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:19.613902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b7b64-46fb-4a68-bd5b-dff325776474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:19.615945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b7b64-46fb-4a68-bd5b-dff325776474 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:19.616428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b7b64-46fb-4a68-bd5b-dff325776474 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:19.617146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b7b64-46fb-4a68-bd5b-dff325776474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:19.618428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b7b64-46fb-4a68-bd5b-dff325776474 None admin] RBAC: Adding query filter params (group.id=3f3f3f5ff3f648e692355102f4f2e77a, role.id=86e9a6602f6945d7b87811b8708df6b7, scope.project.id=f24f46abed0346909dcf67babae2c4d8) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:19.618932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b7b64-46fb-4a68-bd5b-dff325776474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:19.621228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b7b64-46fb-4a68-bd5b-dff325776474 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:19.629512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f40a6-d8e8-485b-9acb-94bdb60adc8a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:19.630799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 227/434] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Jun 28 03:04:19 2022] GET /identity/v3/role_assignments?group.id=3f3f3f5ff3f648e692355102f4f2e77a&scope.project.id=f24f46abed0346909dcf67babae2c4d8&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:19.674053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659f2d8-659b-4323-abc8-8d01ae5e5b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:19.675192 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f2d8-659b-4323-abc8-8d01ae5e5b91 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:19.675649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f2d8-659b-4323-abc8-8d01ae5e5b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:19.676133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f2d8-659b-4323-abc8-8d01ae5e5b91 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:19.677096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659f2d8-659b-4323-abc8-8d01ae5e5b91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:19.677572 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659f2d8-659b-4323-abc8-8d01ae5e5b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:19.679259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659f2d8-659b-4323-abc8-8d01ae5e5b91 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:19.693872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 208/435] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:04:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:19.696755 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b7b64-46fb-4a68-bd5b-dff325776474 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:19.741407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5326dc-2f10-4590-b2d2-c6e9cae91eff None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:19.741715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5326dc-2f10-4590-b2d2-c6e9cae91eff None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:19.742125 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5326dc-2f10-4590-b2d2-c6e9cae91eff None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:19.743919 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 209/436] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:19.749762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6eb4-5bd7-4f9e-802d-cf8382bfd191 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:19.749963 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6eb4-5bd7-4f9e-802d-cf8382bfd191 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:19.750123 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6eb4-5bd7-4f9e-802d-cf8382bfd191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:19.768922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-18cd6eb4-5bd7-4f9e-802d-cf8382bfd191 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:19.770254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-18cd6eb4-5bd7-4f9e-802d-cf8382bfd191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:19.814105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:19.827517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b7b64-46fb-4a68-bd5b-dff325776474 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:19.866898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 210/437] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:19.872490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a26215-5e52-40f3-81e4-266aa03a1fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:19.873162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a26215-5e52-40f3-81e4-266aa03a1fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:19.873442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a26215-5e52-40f3-81e4-266aa03a1fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:19.873718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a26215-5e52-40f3-81e4-266aa03a1fa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:19.890741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6eb4-5bd7-4f9e-802d-cf8382bfd191 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:19.916972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:19.949118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a26215-5e52-40f3-81e4-266aa03a1fa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:19.950657 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a26215-5e52-40f3-81e4-266aa03a1fa8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:20.027435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6eb4-5bd7-4f9e-802d-cf8382bfd191 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:20.081650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe11cb-ffa8-45c9-b791-d51f770e3212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:20.082420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe11cb-ffa8-45c9-b791-d51f770e3212 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:20.082704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe11cb-ffa8-45c9-b791-d51f770e3212 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:20.083015 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe11cb-ffa8-45c9-b791-d51f770e3212 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:20.088933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 228/438] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:20.094222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a26215-5e52-40f3-81e4-266aa03a1fa8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:20.096903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe11cb-ffa8-45c9-b791-d51f770e3212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-eebe11cb-ffa8-45c9-b791-d51f770e3212 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:20.104654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:20.105748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:20.106773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:20.107669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 211/439] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:04:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:20.112593 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe11cb-ffa8-45c9-b791-d51f770e3212 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:20.151965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:20.182383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:20.220902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a26215-5e52-40f3-81e4-266aa03a1fa8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:20.237916 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe11cb-ffa8-45c9-b791-d51f770e3212 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:20.258222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83899194-284c-4ddf-a965-b9419fb714e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:20.259147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83899194-284c-4ddf-a965-b9419fb714e0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:20.259430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83899194-284c-4ddf-a965-b9419fb714e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:20.259705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83899194-284c-4ddf-a965-b9419fb714e0 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:20.260913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83899194-284c-4ddf-a965-b9419fb714e0 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:20.262399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83899194-284c-4ddf-a965-b9419fb714e0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:20.264134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 229/440] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:20 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:20.265336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db04490-d122-4001-b945-95d54a9a7936 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:20.265602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db04490-d122-4001-b945-95d54a9a7936 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:20.265873 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db04490-d122-4001-b945-95d54a9a7936 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:20.267348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 230/441] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:20.272129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db04490-d122-4001-b945-95d54a9a7936 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:20.278204 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8463c-0242-45ba-b9f2-ed4e251ebea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:20.278957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8463c-0242-45ba-b9f2-ed4e251ebea5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:20.279240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8463c-0242-45ba-b9f2-ed4e251ebea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:20.279515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8463c-0242-45ba-b9f2-ed4e251ebea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:20.280306 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8463c-0242-45ba-b9f2-ed4e251ebea5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:20.280612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8463c-0242-45ba-b9f2-ed4e251ebea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:20.282001 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8463c-0242-45ba-b9f2-ed4e251ebea5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:20.291080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 212/442] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:20.292178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3eda-6157-4fb3-ba1e-0019a727aa8f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:20.292466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3eda-6157-4fb3-ba1e-0019a727aa8f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:20.292738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3eda-6157-4fb3-ba1e-0019a727aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:20.309279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-0e2c3eda-6157-4fb3-ba1e-0019a727aa8f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:20.310520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0e2c3eda-6157-4fb3-ba1e-0019a727aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:20.376860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db04490-d122-4001-b945-95d54a9a7936 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:20.377393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 213/443] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:20.378189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c3eda-6157-4fb3-ba1e-0019a727aa8f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:20.397066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:20.414163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6f94b-835f-4512-be3a-5cf04a8acc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:20.415066 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6f94b-835f-4512-be3a-5cf04a8acc6b None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:20.415347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6f94b-835f-4512-be3a-5cf04a8acc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:20.415618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6f94b-835f-4512-be3a-5cf04a8acc6b None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:20.416806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6f94b-835f-4512-be3a-5cf04a8acc6b None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:20.418250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6f94b-835f-4512-be3a-5cf04a8acc6b None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:20.420083 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 231/444] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:20 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:20.420831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6f94b-835f-4512-be3a-5cf04a8acc6b None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:20.429335 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:20.481274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c3eda-6157-4fb3-ba1e-0019a727aa8f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:20.516421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2e280-09ed-452c-8931-a7532f13cd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:20.517123 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2e280-09ed-452c-8931-a7532f13cd22 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:20.517530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2e280-09ed-452c-8931-a7532f13cd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:20.517653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2e280-09ed-452c-8931-a7532f13cd22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:20.523927 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6f94b-835f-4512-be3a-5cf04a8acc6b None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:20.556711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c10204-a48d-485c-b543-4a822cc4beb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:20.557551 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10204-a48d-485c-b543-4a822cc4beb5 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:20.557833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10204-a48d-485c-b543-4a822cc4beb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:20.558107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10204-a48d-485c-b543-4a822cc4beb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:20.569247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c10204-a48d-485c-b543-4a822cc4beb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-54c10204-a48d-485c-b543-4a822cc4beb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:20.576903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:20.577760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:20.578623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 232/445] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:20.583089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c10204-a48d-485c-b543-4a822cc4beb5 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:20.584894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2e280-09ed-452c-8931-a7532f13cd22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:20.586377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2e280-09ed-452c-8931-a7532f13cd22 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:20.604347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:20.649273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:20.684838 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c10204-a48d-485c-b543-4a822cc4beb5 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:20.685753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 214/446] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:20.686618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2e280-09ed-452c-8931-a7532f13cd22 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:20.724872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f5b7-e8c7-4b55-bb3d-bc2e5ee61a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:20.725545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f5b7-e8c7-4b55-bb3d-bc2e5ee61a13 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:20.725828 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f5b7-e8c7-4b55-bb3d-bc2e5ee61a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:20.726098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f5b7-e8c7-4b55-bb3d-bc2e5ee61a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:20.726975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f5b7-e8c7-4b55-bb3d-bc2e5ee61a13 None admin] RBAC: Adding query filter params (group.id=3f3f3f5ff3f648e692355102f4f2e77a, role.id=86e9a6602f6945d7b87811b8708df6b7, scope.project.id=fa972b04f73040768b4e81de2c1b8d95) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:20.727291 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f5b7-e8c7-4b55-bb3d-bc2e5ee61a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:20.728732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f5b7-e8c7-4b55-bb3d-bc2e5ee61a13 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:20.734730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 233/447] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Jun 28 03:04:20 2022] GET /identity/v3/role_assignments?group.id=3f3f3f5ff3f648e692355102f4f2e77a&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=86e9a6602f6945d7b87811b8708df6b7 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:20.739301 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f5b7-e8c7-4b55-bb3d-bc2e5ee61a13 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:20.818532 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2e280-09ed-452c-8931-a7532f13cd22 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:20.843065 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:20.859316 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f5b7-e8c7-4b55-bb3d-bc2e5ee61a13 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:20.864697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19aa1d-20a4-4398-913a-d6940fffcfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:20.866156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19aa1d-20a4-4398-913a-d6940fffcfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:20.866675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19aa1d-20a4-4398-913a-d6940fffcfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:20.867136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19aa1d-20a4-4398-913a-d6940fffcfc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:20.868095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19aa1d-20a4-4398-913a-d6940fffcfc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:20.868503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19aa1d-20a4-4398-913a-d6940fffcfc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:20.870217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19aa1d-20a4-4398-913a-d6940fffcfc5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:20.884672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 215/448] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:20.885869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19aa1d-20a4-4398-913a-d6940fffcfc5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:20.898325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:20.909096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b915101-a209-44c8-b240-8462fd348e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:20.909096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b915101-a209-44c8-b240-8462fd348e15 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:20.909321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b915101-a209-44c8-b240-8462fd348e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:20.909531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b915101-a209-44c8-b240-8462fd348e15 None admin] PATH_INFO: `/v3/projects/fa972b04f73040768b4e81de2c1b8d95` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:20.911019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b915101-a209-44c8-b240-8462fd348e15 None admin] RBAC: Authorizing `identity:get_project(project_id=fa972b04f73040768b4e81de2c1b8d95)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:20.912455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b915101-a209-44c8-b240-8462fd348e15 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:20.914157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 234/449] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:20 2022] GET /identity/v3/projects/fa972b04f73040768b4e81de2c1b8d95 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:20.919717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b915101-a209-44c8-b240-8462fd348e15 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:21.022382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19aa1d-20a4-4398-913a-d6940fffcfc5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:21.072623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b915101-a209-44c8-b240-8462fd348e15 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:21.078578 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6fb44-9eed-47f3-b841-dbe11c8520e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:21.079520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6fb44-9eed-47f3-b841-dbe11c8520e4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:21.079941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6fb44-9eed-47f3-b841-dbe11c8520e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:21.080353 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6fb44-9eed-47f3-b841-dbe11c8520e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:21.123226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78b2e0-b7a7-46f7-b45a-9ac329e21be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:21.123893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78b2e0-b7a7-46f7-b45a-9ac329e21be3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:21.124132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78b2e0-b7a7-46f7-b45a-9ac329e21be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:21.124477 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78b2e0-b7a7-46f7-b45a-9ac329e21be3 None admin] PATH_INFO: `/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:21.125736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78b2e0-b7a7-46f7-b45a-9ac329e21be3 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3f3f5ff3f648e692355102f4f2e77a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:21.127500 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78b2e0-b7a7-46f7-b45a-9ac329e21be3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:21.133929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 235/450] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:20 2022] GET /identity/v3/groups/3f3f3f5ff3f648e692355102f4f2e77a => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:21.135058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78b2e0-b7a7-46f7-b45a-9ac329e21be3 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:21.153988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:21.174440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6fb44-9eed-47f3-b841-dbe11c8520e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:21.175841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6fb44-9eed-47f3-b841-dbe11c8520e4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:21.199315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:21.234623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78b2e0-b7a7-46f7-b45a-9ac329e21be3 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:21.267956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a1a69-a721-4c5d-9f91-5f563ad8ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:21.268626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a1a69-a721-4c5d-9f91-5f563ad8ede9 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:21.268912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a1a69-a721-4c5d-9f91-5f563ad8ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:21.269187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a1a69-a721-4c5d-9f91-5f563ad8ede9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:21.270019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a1a69-a721-4c5d-9f91-5f563ad8ede9 None admin] RBAC: Adding query filter params (group.id=3f3f3f5ff3f648e692355102f4f2e77a, role.id=66ac9c3671cb46b6ae847fdbc68015b3, scope.project.id=fa972b04f73040768b4e81de2c1b8d95) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:21.270360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a1a69-a721-4c5d-9f91-5f563ad8ede9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:21.271811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a1a69-a721-4c5d-9f91-5f563ad8ede9 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:21.271909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 216/451] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:21.277561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6fb44-9eed-47f3-b841-dbe11c8520e4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:21.277873 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 236/452] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Jun 28 03:04:21 2022] GET /identity/v3/role_assignments?group.id=3f3f3f5ff3f648e692355102f4f2e77a&scope.project.id=fa972b04f73040768b4e81de2c1b8d95&role.id=66ac9c3671cb46b6ae847fdbc68015b3 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:21.365294 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:21.389059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6fb44-9eed-47f3-b841-dbe11c8520e4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:21.428625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60675e7-28ac-446e-bf48-4137e5285466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:21.429393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60675e7-28ac-446e-bf48-4137e5285466 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:21.429666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60675e7-28ac-446e-bf48-4137e5285466 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:21.429934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60675e7-28ac-446e-bf48-4137e5285466 None admin] PATH_INFO: `/v3/projects/3e3a42e79f984a37804898fa1c77f82d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:21.431170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60675e7-28ac-446e-bf48-4137e5285466 None admin] RBAC: Authorizing `identity:get_project(project_id=3e3a42e79f984a37804898fa1c77f82d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:21.432625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60675e7-28ac-446e-bf48-4137e5285466 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:21.434311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 217/453] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:04:21 2022] GET /identity/v3/projects/3e3a42e79f984a37804898fa1c77f82d => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:21.440667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a1a69-a721-4c5d-9f91-5f563ad8ede9 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:21.546332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a1a69-a721-4c5d-9f91-5f563ad8ede9 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:21.574861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:21.581980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fedf1-58ca-4a81-8009-2a73a8356658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:21.582935 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fedf1-58ca-4a81-8009-2a73a8356658 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:21.583209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fedf1-58ca-4a81-8009-2a73a8356658 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:21.583473 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fedf1-58ca-4a81-8009-2a73a8356658 None admin] PATH_INFO: `/v3/groups/1d2475e67dd9467298c1792daf268230` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:21.584633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fedf1-58ca-4a81-8009-2a73a8356658 None admin] RBAC: Authorizing `identity:get_group(group_id=1d2475e67dd9467298c1792daf268230)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:21.586067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fedf1-58ca-4a81-8009-2a73a8356658 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:21.587908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 237/454] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Jun 28 03:04:21 2022] GET /identity/v3/groups/1d2475e67dd9467298c1792daf268230 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:21.593865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60675e7-28ac-446e-bf48-4137e5285466 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:21.714386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60675e7-28ac-446e-bf48-4137e5285466 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:21.750760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e9876-92f6-4c24-8bbf-463a3030e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:21.751657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e9876-92f6-4c24-8bbf-463a3030e84f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:21.752248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e9876-92f6-4c24-8bbf-463a3030e84f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:21.752520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e9876-92f6-4c24-8bbf-463a3030e84f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:21.753348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e9876-92f6-4c24-8bbf-463a3030e84f None admin] RBAC: Adding query filter params (group.id=1d2475e67dd9467298c1792daf268230, role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=3e3a42e79f984a37804898fa1c77f82d) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:21.753650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e9876-92f6-4c24-8bbf-463a3030e84f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:21.755126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e9876-92f6-4c24-8bbf-463a3030e84f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:21.761025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 218/455] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Jun 28 03:04:21 2022] GET /identity/v3/role_assignments?group.id=1d2475e67dd9467298c1792daf268230&scope.project.id=3e3a42e79f984a37804898fa1c77f82d&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:24.147035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a47f-c8c0-4855-bd04-9d25206081e7 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:24.147561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a47f-c8c0-4855-bd04-9d25206081e7 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:24.147561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90a47f-c8c0-4855-bd04-9d25206081e7 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:24.149167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 238/456] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:24.154540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ee94-6c2d-4436-a1ae-900e395500b7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:24.155329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ee94-6c2d-4436-a1ae-900e395500b7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:24.155799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ee94-6c2d-4436-a1ae-900e395500b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:24.183261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8494ee94-6c2d-4436-a1ae-900e395500b7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:24.184795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8494ee94-6c2d-4436-a1ae-900e395500b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:24.193137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:24.276318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 219/457] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:24.318057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90a47f-c8c0-4855-bd04-9d25206081e7 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:24.360370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d620ba-6857-446a-a8ca-a8a28d848475 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:24.361053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d620ba-6857-446a-a8ca-a8a28d848475 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:24.361634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d620ba-6857-446a-a8ca-a8a28d848475 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:24.363699 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 220/458] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:24.369611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23044b-8189-4ec3-8bb8-7fe988a0f67e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:24.370204 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23044b-8189-4ec3-8bb8-7fe988a0f67e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:24.370713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23044b-8189-4ec3-8bb8-7fe988a0f67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:24.388906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8d23044b-8189-4ec3-8bb8-7fe988a0f67e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:24.390475 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8d23044b-8189-4ec3-8bb8-7fe988a0f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:24.480238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90a47f-c8c0-4855-bd04-9d25206081e7 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:24.503397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 221/459] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:24.535361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45748d-e84c-43c0-8cc4-ddf22788a673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:24.536633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45748d-e84c-43c0-8cc4-ddf22788a673 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:24.537140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45748d-e84c-43c0-8cc4-ddf22788a673 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:24.537608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45748d-e84c-43c0-8cc4-ddf22788a673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:24.540664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23044b-8189-4ec3-8bb8-7fe988a0f67e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:24.564398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45748d-e84c-43c0-8cc4-ddf22788a673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:24.569491 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45748d-e84c-43c0-8cc4-ddf22788a673 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-6e45748d-e84c-43c0-8cc4-ddf22788a673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:24.602045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:24.602999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:24.603881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:24.603881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:24.603881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:24.603881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:24.617102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 239/460] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:24.624308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45748d-e84c-43c0-8cc4-ddf22788a673 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:24.671474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:24.714660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:24.729263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23044b-8189-4ec3-8bb8-7fe988a0f67e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:24.799420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d268ed6-eb04-4cfe-8df5-00fe0ad6193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:24.800652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d268ed6-eb04-4cfe-8df5-00fe0ad6193d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:24.802569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d268ed6-eb04-4cfe-8df5-00fe0ad6193d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:24.804073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d268ed6-eb04-4cfe-8df5-00fe0ad6193d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:24.810187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45748d-e84c-43c0-8cc4-ddf22788a673 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:24.826026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d268ed6-eb04-4cfe-8df5-00fe0ad6193d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:24.827490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d268ed6-eb04-4cfe-8df5-00fe0ad6193d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-8d268ed6-eb04-4cfe-8df5-00fe0ad6193d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:24.849550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:24.850649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:24.851645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:24.851645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:24.851645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:24.851645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:24.851645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 222/461] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:24.852380 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7626e1-3619-475b-a99c-8e1a5457c921 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:24.852665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7626e1-3619-475b-a99c-8e1a5457c921 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:24.852940 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7626e1-3619-475b-a99c-8e1a5457c921 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:24.854490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 223/462] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:24.855773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86cffd-ac3c-4ec1-ae55-b1aaf052380e None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:24.856058 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86cffd-ac3c-4ec1-ae55-b1aaf052380e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:24.856330 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86cffd-ac3c-4ec1-ae55-b1aaf052380e None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:24.857656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 224/463] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:24.858305 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86cffd-ac3c-4ec1-ae55-b1aaf052380e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:24.864243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804494-a0de-4173-a66e-3c3c469d7fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:24.865038 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804494-a0de-4173-a66e-3c3c469d7fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:24.865748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804494-a0de-4173-a66e-3c3c469d7fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:24.866088 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804494-a0de-4173-a66e-3c3c469d7fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:24.866937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0804494-a0de-4173-a66e-3c3c469d7fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:24.867307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0804494-a0de-4173-a66e-3c3c469d7fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:24.868932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0804494-a0de-4173-a66e-3c3c469d7fb4 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:24.881944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 240/464] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:24.883152 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c103c-e47f-46c4-a75d-710c4e5c7192 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:24.883440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c103c-e47f-46c4-a75d-710c4e5c7192 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:24.883710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c103c-e47f-46c4-a75d-710c4e5c7192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:24.901883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-098c103c-e47f-46c4-a75d-710c4e5c7192 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:24.903122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-098c103c-e47f-46c4-a75d-710c4e5c7192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:24.971038 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 241/465] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:24.972334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944a254-68ee-4b67-97cf-7114b42ec2e4 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:24.972621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944a254-68ee-4b67-97cf-7114b42ec2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:24.972887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944a254-68ee-4b67-97cf-7114b42ec2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:24.980127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86cffd-ac3c-4ec1-ae55-b1aaf052380e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:24.997968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-9944a254-68ee-4b67-97cf-7114b42ec2e4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:24.999699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9944a254-68ee-4b67-97cf-7114b42ec2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:25.009049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:25.021215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d794670-3726-445b-bf3b-a11d059103f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:25.021886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d794670-3726-445b-bf3b-a11d059103f4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:25.022161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d794670-3726-445b-bf3b-a11d059103f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:25.022490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d794670-3726-445b-bf3b-a11d059103f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:25.023180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d794670-3726-445b-bf3b-a11d059103f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:25.023480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d794670-3726-445b-bf3b-a11d059103f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:25.024874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d794670-3726-445b-bf3b-a11d059103f4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:25.035376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:25.042370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 225/466] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:25.042370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d794670-3726-445b-bf3b-a11d059103f4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:25.072699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 242/467] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:25.083224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944a254-68ee-4b67-97cf-7114b42ec2e4 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:25.150469 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d794670-3726-445b-bf3b-a11d059103f4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:25.185024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55fb57-1dcd-449f-8ec1-3cbc54642f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:25.185739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55fb57-1dcd-449f-8ec1-3cbc54642f94 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:25.185981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55fb57-1dcd-449f-8ec1-3cbc54642f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:25.186255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55fb57-1dcd-449f-8ec1-3cbc54642f94 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:25.186988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55fb57-1dcd-449f-8ec1-3cbc54642f94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:25.188950 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55fb57-1dcd-449f-8ec1-3cbc54642f94 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:25.191167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944a254-68ee-4b67-97cf-7114b42ec2e4 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:25.222323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 226/468] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:04:25 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:04:25.222323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55fb57-1dcd-449f-8ec1-3cbc54642f94 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:25.243251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a78be-d501-4ba4-94e8-d6da4a546df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:25.244647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a78be-d501-4ba4-94e8-d6da4a546df3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:25.245052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a78be-d501-4ba4-94e8-d6da4a546df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:25.245322 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a78be-d501-4ba4-94e8-d6da4a546df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:25.259731 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:25.261355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a78be-d501-4ba4-94e8-d6da4a546df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:25.263173 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a78be-d501-4ba4-94e8-d6da4a546df3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-fa9a78be-d501-4ba4-94e8-d6da4a546df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:25.287468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:25.288423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:25.289267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:25.289267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:25.289267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:25.289267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:25.294643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 243/469] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:25.295709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a78be-d501-4ba4-94e8-d6da4a546df3 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:25.334419 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55fb57-1dcd-449f-8ec1-3cbc54642f94 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:25.334600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:25.376745 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f176d-7562-42f6-8cbf-6d086f601ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:25.377485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f176d-7562-42f6-8cbf-6d086f601ef3 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:25.377772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f176d-7562-42f6-8cbf-6d086f601ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:25.378047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f176d-7562-42f6-8cbf-6d086f601ef3 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:25.378818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f176d-7562-42f6-8cbf-6d086f601ef3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:25.380328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f176d-7562-42f6-8cbf-6d086f601ef3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:25.403747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 227/470] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:04:25 2022] POST /identity/v3/users => generated 248 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:04:25.405241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f176d-7562-42f6-8cbf-6d086f601ef3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:25.451700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a78be-d501-4ba4-94e8-d6da4a546df3 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:25.499376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a417ad7-3ab6-4565-91b9-9244d8069169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:25.500218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417ad7-3ab6-4565-91b9-9244d8069169 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:25.500484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417ad7-3ab6-4565-91b9-9244d8069169 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:25.500752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417ad7-3ab6-4565-91b9-9244d8069169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:25.517734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a417ad7-3ab6-4565-91b9-9244d8069169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:25.520532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a417ad7-3ab6-4565-91b9-9244d8069169 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:25.543591 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-6a417ad7-3ab6-4565-91b9-9244d8069169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:25.549749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:25.550724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:25.551578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:25.551578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:25.551578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:25.551578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:25.551812 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f176d-7562-42f6-8cbf-6d086f601ef3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:25.555385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 244/471] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:25.566089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a417ad7-3ab6-4565-91b9-9244d8069169 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:25.603411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec8d8-3caa-49a2-8d61-820c05926a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:25.604010 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec8d8-3caa-49a2-8d61-820c05926a69 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:25.604285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec8d8-3caa-49a2-8d61-820c05926a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:25.604563 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec8d8-3caa-49a2-8d61-820c05926a69 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:25.605289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ec8d8-3caa-49a2-8d61-820c05926a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:25.605615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ec8d8-3caa-49a2-8d61-820c05926a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:25.607012 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ec8d8-3caa-49a2-8d61-820c05926a69 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:25.626423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 228/472] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:25.631566 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec8d8-3caa-49a2-8d61-820c05926a69 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:25.678721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:25.714045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a417ad7-3ab6-4565-91b9-9244d8069169 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:25.745632 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec8d8-3caa-49a2-8d61-820c05926a69 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:25.763565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044014b2-691d-4c9f-8cf9-62c5f067bdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:25.764619 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044014b2-691d-4c9f-8cf9-62c5f067bdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:25.765547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044014b2-691d-4c9f-8cf9-62c5f067bdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:25.766308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044014b2-691d-4c9f-8cf9-62c5f067bdc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:25.767314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044014b2-691d-4c9f-8cf9-62c5f067bdc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:25.768049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044014b2-691d-4c9f-8cf9-62c5f067bdc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:25.770081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044014b2-691d-4c9f-8cf9-62c5f067bdc6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:25.786407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 245/473] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:25.789161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4e9ef-839b-424c-b6f2-0410b354dd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:25.789850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4e9ef-839b-424c-b6f2-0410b354dd9d None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:25.790132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4e9ef-839b-424c-b6f2-0410b354dd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:25.790696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4e9ef-839b-424c-b6f2-0410b354dd9d None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:25.791414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4e9ef-839b-424c-b6f2-0410b354dd9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:25.791742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044014b2-691d-4c9f-8cf9-62c5f067bdc6 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:25.792925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4e9ef-839b-424c-b6f2-0410b354dd9d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:25.824596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 229/474] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:04:25 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:04:25.864085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a0496-a1eb-4cfe-853f-3fe468620de3 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:25.864431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a0496-a1eb-4cfe-853f-3fe468620de3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:25.864689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a0496-a1eb-4cfe-853f-3fe468620de3 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:25.866993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 230/475] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:04:25.874827 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a17874-0bf5-45cf-8025-0f1ba280ad99 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:25.875111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a17874-0bf5-45cf-8025-0f1ba280ad99 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:25.875385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a17874-0bf5-45cf-8025-0f1ba280ad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:25.911503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b0a17874-0bf5-45cf-8025-0f1ba280ad99 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:25.912733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b0a17874-0bf5-45cf-8025-0f1ba280ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:25.926674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:25.933786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044014b2-691d-4c9f-8cf9-62c5f067bdc6 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:25.977178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac977-e835-406f-bd14-73b226b924e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:25.977891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac977-e835-406f-bd14-73b226b924e7 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:25.978168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac977-e835-406f-bd14-73b226b924e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:25.978532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac977-e835-406f-bd14-73b226b924e7 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:25.979558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ac977-e835-406f-bd14-73b226b924e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:25.981242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ac977-e835-406f-bd14-73b226b924e7 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:25.989742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:26.007698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 246/476] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:04:25 2022] POST /identity/v3/users => generated 249 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:04:26.069172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 231/477] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:26.098460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac977-e835-406f-bd14-73b226b924e7 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:26.212220 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac977-e835-406f-bd14-73b226b924e7 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:26.248922 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fede3c-bcda-442c-a251-cc6eb4e2e0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:26.249602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fede3c-bcda-442c-a251-cc6eb4e2e0e4 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:26.249876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fede3c-bcda-442c-a251-cc6eb4e2e0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:26.250147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fede3c-bcda-442c-a251-cc6eb4e2e0e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:26.251055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fede3c-bcda-442c-a251-cc6eb4e2e0e4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:26.252516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fede3c-bcda-442c-a251-cc6eb4e2e0e4 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:26.262203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.sql.core [None req-74fede3c-bcda-442c-a251-cc6eb4e2e0e4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 28 03:04:26.262203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 28 03:04:26.262203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [parameters: {'id': '24c26aa856f44fa0b6a04e366dcc8bd9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 28 03:04:26.262203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80342) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-74fede3c-bcda-442c-a251-cc6eb4e2e0e4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application conn.query(q) Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result.read() Jun 28 03:04:26.279191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return ref.to_dict() Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 03:04:26.280158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application next(self.gen) Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application yield resource Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application next(self.gen) Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.session.rollback() Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.force_reraise() Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise self.value Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application session.commit() Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 28 03:04:26.281071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._prepare_impl() Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.session.flush() Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._flush(objects) Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application compat.raise_( Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application flush_context.execute() Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rec.execute(self) Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 28 03:04:26.281912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 03:04:26.284345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application conn.query(q) Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result.read() Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 03:04:26.286248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [parameters: {'id': '24c26aa856f44fa0b6a04e366dcc8bd9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:26.288430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 28 03:04:26.298945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:26.300874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 247/478] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Jun 28 03:04:26 2022] POST /identity/v3/roles => generated 144 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:26.301008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a17874-0bf5-45cf-8025-0f1ba280ad99 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:26.393266 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a17874-0bf5-45cf-8025-0f1ba280ad99 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:26.428611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667fc89-fe62-4b66-ace6-ec16b5a889fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:26.429440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667fc89-fe62-4b66-ace6-ec16b5a889fe None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:26.429712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667fc89-fe62-4b66-ace6-ec16b5a889fe None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:26.429982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667fc89-fe62-4b66-ace6-ec16b5a889fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:26.440847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667fc89-fe62-4b66-ace6-ec16b5a889fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-8667fc89-fe62-4b66-ace6-ec16b5a889fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:26.449314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:26.451668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:26.453554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 232/479] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:04:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:26.456713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fede3c-bcda-442c-a251-cc6eb4e2e0e4 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:26.522808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:26.562014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fede3c-bcda-442c-a251-cc6eb4e2e0e4 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:26.601825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70772e82-750a-48ca-abae-87a5267e9ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:26.601825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772e82-750a-48ca-abae-87a5267e9ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:26.601825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772e82-750a-48ca-abae-87a5267e9ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:26.601825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70772e82-750a-48ca-abae-87a5267e9ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:26.603461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70772e82-750a-48ca-abae-87a5267e9ef2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:26.603461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70772e82-750a-48ca-abae-87a5267e9ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:26.603461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70772e82-750a-48ca-abae-87a5267e9ef2 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:26.612523 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 248/480] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:27.920761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa54bcd-80e3-408d-a269-7c9a65bc2660 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:27.921448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa54bcd-80e3-408d-a269-7c9a65bc2660 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:27.921448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa54bcd-80e3-408d-a269-7c9a65bc2660 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:27.923275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 233/481] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:27.929008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c861be-b665-46f4-8629-3468dd0c18b8 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:27.929612 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c861be-b665-46f4-8629-3468dd0c18b8 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:27.929612 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c861be-b665-46f4-8629-3468dd0c18b8 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:27.932299 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68858d9-423f-4c53-ab70-9e3cd867e5ae None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:27.932573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68858d9-423f-4c53-ab70-9e3cd867e5ae None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:27.932842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68858d9-423f-4c53-ab70-9e3cd867e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:27.938079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:27.938514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 249/482] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:27.943963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe77f44-7128-412a-9d73-e9e44ece66e3 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:27.944303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe77f44-7128-412a-9d73-e9e44ece66e3 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:27.944595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe77f44-7128-412a-9d73-e9e44ece66e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:27.961141 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c68858d9-423f-4c53-ab70-9e3cd867e5ae None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:27.963311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c68858d9-423f-4c53-ab70-9e3cd867e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:27.984587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-0fe77f44-7128-412a-9d73-e9e44ece66e3 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:27.985831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-0fe77f44-7128-412a-9d73-e9e44ece66e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:28.072985 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 234/483] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:28.095718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68858d9-423f-4c53-ab70-9e3cd867e5ae None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:28.136994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 250/484] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:28.174648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe77f44-7128-412a-9d73-e9e44ece66e3 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:28.197925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68858d9-423f-4c53-ab70-9e3cd867e5ae None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:28.243696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:28.266796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:28.276862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b48b56-4d6b-472c-bdc2-fc5704674097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:28.277688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b48b56-4d6b-472c-bdc2-fc5704674097 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:28.277969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b48b56-4d6b-472c-bdc2-fc5704674097 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:28.278242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b48b56-4d6b-472c-bdc2-fc5704674097 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:28.300116 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b48b56-4d6b-472c-bdc2-fc5704674097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-48b48b56-4d6b-472c-bdc2-fc5704674097 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:28.312677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:28.313796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:28.314624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:28.318315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 235/485] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:28.320391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b48b56-4d6b-472c-bdc2-fc5704674097 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:28.380217 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe77f44-7128-412a-9d73-e9e44ece66e3 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:28.456107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f58b07-ab79-4eb2-8955-44f8f1ec5685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:28.456851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f58b07-ab79-4eb2-8955-44f8f1ec5685 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:28.457170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f58b07-ab79-4eb2-8955-44f8f1ec5685 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:28.457447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f58b07-ab79-4eb2-8955-44f8f1ec5685 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:28.479647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b48b56-4d6b-472c-bdc2-fc5704674097 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:28.481681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f58b07-ab79-4eb2-8955-44f8f1ec5685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-95f58b07-ab79-4eb2-8955-44f8f1ec5685 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:28.492478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:28.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:28.494276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:28.502359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 251/486] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:28.503416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f58b07-ab79-4eb2-8955-44f8f1ec5685 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:28.534978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb96164-e8fb-4107-b583-462654ce51e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:28.536756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb96164-e8fb-4107-b583-462654ce51e5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:28.537257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb96164-e8fb-4107-b583-462654ce51e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:28.537949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb96164-e8fb-4107-b583-462654ce51e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:28.539437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb96164-e8fb-4107-b583-462654ce51e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:28.540033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb96164-e8fb-4107-b583-462654ce51e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:28.542269 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb96164-e8fb-4107-b583-462654ce51e5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:28.555150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 236/487] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:28.557159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4041be0-2d56-45d0-ae27-920cf04266e6 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:28.557654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4041be0-2d56-45d0-ae27-920cf04266e6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:28.558113 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4041be0-2d56-45d0-ae27-920cf04266e6 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:28.563676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 237/488] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:28.563676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4041be0-2d56-45d0-ae27-920cf04266e6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:28.632694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f58b07-ab79-4eb2-8955-44f8f1ec5685 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:28.639009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:28.641356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:28.672965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933c1e3-5a63-4d66-aa43-1f6a05275e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:28.673704 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c1e3-5a63-4d66-aa43-1f6a05275e49 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:28.674008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c1e3-5a63-4d66-aa43-1f6a05275e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:28.674282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c1e3-5a63-4d66-aa43-1f6a05275e49 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:28.675247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933c1e3-5a63-4d66-aa43-1f6a05275e49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:28.675351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933c1e3-5a63-4d66-aa43-1f6a05275e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:28.676718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933c1e3-5a63-4d66-aa43-1f6a05275e49 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:28.686876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 252/489] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:28.688378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e0b4-87fa-42e6-9b96-716edafefc4e None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:28.688905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e0b4-87fa-42e6-9b96-716edafefc4e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:28.689288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e0b4-87fa-42e6-9b96-716edafefc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:28.700637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4041be0-2d56-45d0-ae27-920cf04266e6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:28.707743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e3c8e0b4-87fa-42e6-9b96-716edafefc4e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:28.708980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e3c8e0b4-87fa-42e6-9b96-716edafefc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:28.738769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea348fc-e592-4492-a611-be6b951cc867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:28.739591 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea348fc-e592-4492-a611-be6b951cc867 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:28.739880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea348fc-e592-4492-a611-be6b951cc867 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:28.740155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea348fc-e592-4492-a611-be6b951cc867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:28.750968 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea348fc-e592-4492-a611-be6b951cc867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:28.752587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea348fc-e592-4492-a611-be6b951cc867 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-7ea348fc-e592-4492-a611-be6b951cc867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:28.769856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:28.770920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:28.771818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:28.771818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:28.771818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:28.771818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:28.771818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 238/490] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:28.772746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46cfda-b82d-41f6-8635-e89dd987b655 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:28.773029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46cfda-b82d-41f6-8635-e89dd987b655 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:28.773306 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46cfda-b82d-41f6-8635-e89dd987b655 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:28.778820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 239/491] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:28.779504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46cfda-b82d-41f6-8635-e89dd987b655 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:28.788490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 253/492] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:28.789352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8e0b4-87fa-42e6-9b96-716edafefc4e None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:28.895085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:28.898225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46cfda-b82d-41f6-8635-e89dd987b655 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:28.898693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8e0b4-87fa-42e6-9b96-716edafefc4e None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:28.905359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:28.932470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285aecee-918d-4f05-95f5-292ba0e6d789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:28.933283 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285aecee-918d-4f05-95f5-292ba0e6d789 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:28.933564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285aecee-918d-4f05-95f5-292ba0e6d789 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:28.933833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285aecee-918d-4f05-95f5-292ba0e6d789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:28.936587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fb35f-faaf-432b-be13-45e781f0d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:28.937183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb35f-faaf-432b-be13-45e781f0d335 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:28.937467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb35f-faaf-432b-be13-45e781f0d335 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:28.937745 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb35f-faaf-432b-be13-45e781f0d335 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:28.938576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fb35f-faaf-432b-be13-45e781f0d335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:28.938935 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fb35f-faaf-432b-be13-45e781f0d335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:28.940319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fb35f-faaf-432b-be13-45e781f0d335 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:28.945100 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285aecee-918d-4f05-95f5-292ba0e6d789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:28.946599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285aecee-918d-4f05-95f5-292ba0e6d789 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:28.953997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 254/493] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:28.955501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f9473-e9d5-42b2-a3b5-6ee79c2f6947 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:28.955784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f9473-e9d5-42b2-a3b5-6ee79c2f6947 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:28.956059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f9473-e9d5-42b2-a3b5-6ee79c2f6947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-285aecee-918d-4f05-95f5-292ba0e6d789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:28.969747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:28.970643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:28.971492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:28.971492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:28.971492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:28.971492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:28.971492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 240/494] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:28.971761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285aecee-918d-4f05-95f5-292ba0e6d789 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:28.977728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6f0f9473-e9d5-42b2-a3b5-6ee79c2f6947 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:28.978965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6f0f9473-e9d5-42b2-a3b5-6ee79c2f6947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:29.058467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 255/495] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:29.058467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f9473-e9d5-42b2-a3b5-6ee79c2f6947 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:29.080471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285aecee-918d-4f05-95f5-292ba0e6d789 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:29.115656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe528e-353e-4c08-bc3c-929a01d24eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:29.117133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe528e-353e-4c08-bc3c-929a01d24eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.117849 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe528e-353e-4c08-bc3c-929a01d24eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.118438 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe528e-353e-4c08-bc3c-929a01d24eb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.131732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe528e-353e-4c08-bc3c-929a01d24eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-38fe528e-353e-4c08-bc3c-929a01d24eb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:29.142049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:29.143135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:29.144115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:29.152325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 241/496] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:29.152325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe528e-353e-4c08-bc3c-929a01d24eb3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:29.166640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:29.173489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:29.180672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f9473-e9d5-42b2-a3b5-6ee79c2f6947 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:29.216393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc94b0-28df-4948-8c7f-614bb27d120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:29.217210 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc94b0-28df-4948-8c7f-614bb27d120c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.217490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc94b0-28df-4948-8c7f-614bb27d120c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.217754 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc94b0-28df-4948-8c7f-614bb27d120c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.225696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc94b0-28df-4948-8c7f-614bb27d120c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:29.227100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc94b0-28df-4948-8c7f-614bb27d120c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-eefc94b0-28df-4948-8c7f-614bb27d120c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:29.243613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:29.244546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:29.245442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:29.245442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:29.245442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:29.245442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:29.245442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:29.245442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:29.245442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:29.245442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:29.245442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 28 03:04:29.245442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:29.245442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 256/497] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:29.246388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc94b0-28df-4948-8c7f-614bb27d120c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:29.259548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe528e-353e-4c08-bc3c-929a01d24eb3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:29.296090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224e5d-b88f-4e8e-bdb0-da212481547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:29.296768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224e5d-b88f-4e8e-bdb0-da212481547a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.297048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224e5d-b88f-4e8e-bdb0-da212481547a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.297321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224e5d-b88f-4e8e-bdb0-da212481547a None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.298108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45224e5d-b88f-4e8e-bdb0-da212481547a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:29.298444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45224e5d-b88f-4e8e-bdb0-da212481547a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:29.299836 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45224e5d-b88f-4e8e-bdb0-da212481547a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:29.312494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 242/498] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:29.317176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224e5d-b88f-4e8e-bdb0-da212481547a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:29.357530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc94b0-28df-4948-8c7f-614bb27d120c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:29.396119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6603a-729f-4abb-b917-65aecbce135a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:29.396659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:29.397001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6603a-729f-4abb-b917-65aecbce135a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.397286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6603a-729f-4abb-b917-65aecbce135a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.397584 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6603a-729f-4abb-b917-65aecbce135a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.409372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6603a-729f-4abb-b917-65aecbce135a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-52e6603a-729f-4abb-b917-65aecbce135a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:29.417292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:29.418193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:29.419028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 257/499] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:29.419668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6603a-729f-4abb-b917-65aecbce135a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:29.422607 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224e5d-b88f-4e8e-bdb0-da212481547a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:29.436709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:29.459083 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e41104-8d3f-4471-b482-d6a832e6477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:29.459768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e41104-8d3f-4471-b482-d6a832e6477e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.460049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e41104-8d3f-4471-b482-d6a832e6477e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.460327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e41104-8d3f-4471-b482-d6a832e6477e None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.461082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e41104-8d3f-4471-b482-d6a832e6477e None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:29.461390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e41104-8d3f-4471-b482-d6a832e6477e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:29.462834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e41104-8d3f-4471-b482-d6a832e6477e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:29.471100 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 243/500] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:29.471878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e41104-8d3f-4471-b482-d6a832e6477e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:29.533974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6603a-729f-4abb-b917-65aecbce135a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:29.566895 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7d51c-5985-4117-bb7c-c798e017b958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:29.567564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7d51c-5985-4117-bb7c-c798e017b958 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.567843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7d51c-5985-4117-bb7c-c798e017b958 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.568098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7d51c-5985-4117-bb7c-c798e017b958 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.568939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7d51c-5985-4117-bb7c-c798e017b958 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:29.569248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7d51c-5985-4117-bb7c-c798e017b958 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:29.570725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7d51c-5985-4117-bb7c-c798e017b958 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:29.571248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e41104-8d3f-4471-b482-d6a832e6477e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:29.604045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7e2c1-385f-4ce2-83f0-474418172238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:29.604846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7e2c1-385f-4ce2-83f0-474418172238 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.605126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7e2c1-385f-4ce2-83f0-474418172238 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.605402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7e2c1-385f-4ce2-83f0-474418172238 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.607384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 258/501] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Jun 28 03:04:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:29.608194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7d51c-5985-4117-bb7c-c798e017b958 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:29.613367 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7e2c1-385f-4ce2-83f0-474418172238 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:29.614859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7e2c1-385f-4ce2-83f0-474418172238 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:29.617770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-1ac7e2c1-385f-4ce2-83f0-474418172238 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:29.631872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:29.632791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:29.633678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:29.633678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:29.633678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:29.633678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:29.633678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:29.633678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:29.633678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:29.633678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:29.633678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:04:29.633678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:29.633678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 244/502] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Jun 28 03:04:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:29.634411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146d14-e508-4d8f-bab1-005271a41120 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.634666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146d14-e508-4d8f-bab1-005271a41120 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.634939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146d14-e508-4d8f-bab1-005271a41120 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.636315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 245/503] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:29.636851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75146d14-e508-4d8f-bab1-005271a41120 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:29.679842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:29.718570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7d51c-5985-4117-bb7c-c798e017b958 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:29.739122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75146d14-e508-4d8f-bab1-005271a41120 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:29.755042 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36408e-9484-41e6-bd38-765bf3b8d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:29.755766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36408e-9484-41e6-bd38-765bf3b8d844 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.756043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36408e-9484-41e6-bd38-765bf3b8d844 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.756363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36408e-9484-41e6-bd38-765bf3b8d844 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.757134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36408e-9484-41e6-bd38-765bf3b8d844 None admin] RBAC: Adding query filter params (name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:29.757435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36408e-9484-41e6-bd38-765bf3b8d844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:29.758856 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36408e-9484-41e6-bd38-765bf3b8d844 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:29.766682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 259/504] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:29.767480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36408e-9484-41e6-bd38-765bf3b8d844 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:29.772884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0f2a1-6b22-4ac5-88db-f92ad5621151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:29.773692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0f2a1-6b22-4ac5-88db-f92ad5621151 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.773971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0f2a1-6b22-4ac5-88db-f92ad5621151 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.774238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0f2a1-6b22-4ac5-88db-f92ad5621151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.785586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0f2a1-6b22-4ac5-88db-f92ad5621151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:29.787027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0f2a1-6b22-4ac5-88db-f92ad5621151 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-8af0f2a1-6b22-4ac5-88db-f92ad5621151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:29.804043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:29.805081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:29.805962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:29.805962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:29.805962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:29.805962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:29.805962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 246/505] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:29.806233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0f2a1-6b22-4ac5-88db-f92ad5621151 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:29.857511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:29.874757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36408e-9484-41e6-bd38-765bf3b8d844 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:29.901548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:29.907281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0f2a1-6b22-4ac5-88db-f92ad5621151 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:29.909833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269def69-a242-4ca7-ac3b-12b71d718400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:29.910519 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269def69-a242-4ca7-ac3b-12b71d718400 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.910806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269def69-a242-4ca7-ac3b-12b71d718400 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.911080 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269def69-a242-4ca7-ac3b-12b71d718400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.941864 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447abf2-ac85-47ae-a841-e266da22da9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:29.942564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447abf2-ac85-47ae-a841-e266da22da9c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.942855 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447abf2-ac85-47ae-a841-e266da22da9c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.943126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447abf2-ac85-47ae-a841-e266da22da9c None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:29.944035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447abf2-ac85-47ae-a841-e266da22da9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:29.944340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447abf2-ac85-47ae-a841-e266da22da9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:29.945801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447abf2-ac85-47ae-a841-e266da22da9c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:29.978687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269def69-a242-4ca7-ac3b-12b71d718400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:29.980155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269def69-a242-4ca7-ac3b-12b71d718400 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:29.981674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 247/506] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Jun 28 03:04:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:29.982905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52bbc8-ae6c-4557-a901-e4cacdf63ad5 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:29.983191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52bbc8-ae6c-4557-a901-e4cacdf63ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:29.983465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52bbc8-ae6c-4557-a901-e4cacdf63ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:30.000468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-bf52bbc8-ae6c-4557-a901-e4cacdf63ad5 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:30.002019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bf52bbc8-ae6c-4557-a901-e4cacdf63ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:30.074160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 248/507] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:30.075062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52bbc8-ae6c-4557-a901-e4cacdf63ad5 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:30.097700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 260/508] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:30.098577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269def69-a242-4ca7-ac3b-12b71d718400 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:30.124474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:30.129009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:30.181961 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52bbc8-ae6c-4557-a901-e4cacdf63ad5 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:30.198118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269def69-a242-4ca7-ac3b-12b71d718400 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:30.215004 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041251c-b348-47af-bcf6-a5eb7267733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:30.215806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041251c-b348-47af-bcf6-a5eb7267733d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:30.216090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041251c-b348-47af-bcf6-a5eb7267733d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:30.216362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041251c-b348-47af-bcf6-a5eb7267733d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:30.226489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041251c-b348-47af-bcf6-a5eb7267733d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:30.227970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041251c-b348-47af-bcf6-a5eb7267733d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:30.231725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f35dd-66cb-4d1e-aaa3-39ba00672922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:30.232385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f35dd-66cb-4d1e-aaa3-39ba00672922 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:30.232664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f35dd-66cb-4d1e-aaa3-39ba00672922 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:30.232932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f35dd-66cb-4d1e-aaa3-39ba00672922 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:30.233652 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f35dd-66cb-4d1e-aaa3-39ba00672922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:30.233951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f35dd-66cb-4d1e-aaa3-39ba00672922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:30.235763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f35dd-66cb-4d1e-aaa3-39ba00672922 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b041251c-b348-47af-bcf6-a5eb7267733d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:30.245628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:30.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:30.247401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:30.247401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:30.247401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:30.247401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:30.247401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 249/509] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:30.247671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041251c-b348-47af-bcf6-a5eb7267733d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:30.253820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 261/510] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:30.253820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f35dd-66cb-4d1e-aaa3-39ba00672922 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:30.338081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:30.343327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:30.351525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f35dd-66cb-4d1e-aaa3-39ba00672922 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:30.353345 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041251c-b348-47af-bcf6-a5eb7267733d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:30.385439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3f98b-7da3-4514-8056-73513c3d4f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:30.386428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3f98b-7da3-4514-8056-73513c3d4f3e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:30.386702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3f98b-7da3-4514-8056-73513c3d4f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:30.386981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3f98b-7da3-4514-8056-73513c3d4f3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:30.398447 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dd747-5cb1-49e7-89bf-0fcc3fd18731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:30.398630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3f98b-7da3-4514-8056-73513c3d4f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:30.399118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dd747-5cb1-49e7-89bf-0fcc3fd18731 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:30.399399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dd747-5cb1-49e7-89bf-0fcc3fd18731 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:30.399669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dd747-5cb1-49e7-89bf-0fcc3fd18731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:30.400079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3f98b-7da3-4514-8056-73513c3d4f3e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-cec3f98b-7da3-4514-8056-73513c3d4f3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:30.417145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:30.418044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:30.418941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:30.418941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:30.418941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:30.418941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:30.418941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 262/511] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:30.419306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3f98b-7da3-4514-8056-73513c3d4f3e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:30.471298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7dd747-5cb1-49e7-89bf-0fcc3fd18731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:30.472878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7dd747-5cb1-49e7-89bf-0fcc3fd18731 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:30.525721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3f98b-7da3-4514-8056-73513c3d4f3e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:30.558450 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d4085-f636-4183-b87a-5debc22f6bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:30.559251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d4085-f636-4183-b87a-5debc22f6bea None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:30.559529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d4085-f636-4183-b87a-5debc22f6bea None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:30.559800 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d4085-f636-4183-b87a-5debc22f6bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:30.564204 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:30.569071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:30.571265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d4085-f636-4183-b87a-5debc22f6bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:30.572958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d4085-f636-4183-b87a-5debc22f6bea None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:30.574902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 250/512] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:30.575727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dd747-5cb1-49e7-89bf-0fcc3fd18731 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-b52d4085-f636-4183-b87a-5debc22f6bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:30.591602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:30.592636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:30.593550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:30.593550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:30.593550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:30.593550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:30.593550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 263/513] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:30.593550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d4085-f636-4183-b87a-5debc22f6bea None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:30.681327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dd747-5cb1-49e7-89bf-0fcc3fd18731 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:30.693575 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d4085-f636-4183-b87a-5debc22f6bea None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:30.718744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289727e-5d3e-4d51-b15b-5952df107a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:30.719947 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289727e-5d3e-4d51-b15b-5952df107a7a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:30.720448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289727e-5d3e-4d51-b15b-5952df107a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:30.720919 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289727e-5d3e-4d51-b15b-5952df107a7a None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:30.721967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289727e-5d3e-4d51-b15b-5952df107a7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:30.722271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289727e-5d3e-4d51-b15b-5952df107a7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:30.723720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289727e-5d3e-4d51-b15b-5952df107a7a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:30.726823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46596cc4-f3b5-4577-b1d6-6eadc5d9ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:30.727640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46596cc4-f3b5-4577-b1d6-6eadc5d9ac23 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:30.727923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46596cc4-f3b5-4577-b1d6-6eadc5d9ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:30.728200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46596cc4-f3b5-4577-b1d6-6eadc5d9ac23 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:30.736947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46596cc4-f3b5-4577-b1d6-6eadc5d9ac23 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:30.737417 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 251/514] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:30.738257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289727e-5d3e-4d51-b15b-5952df107a7a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:30.738696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46596cc4-f3b5-4577-b1d6-6eadc5d9ac23 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-46596cc4-f3b5-4577-b1d6-6eadc5d9ac23 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:30.756370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:30.757351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:30.758232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:30.758232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:30.758232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:30.758232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:30.758232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:30.758232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:30.758232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:30.758232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:30.758232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 03:04:30.758232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:30.758232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 264/515] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:30.758819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46596cc4-f3b5-4577-b1d6-6eadc5d9ac23 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:30.808799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:30.811548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:30.858910 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46596cc4-f3b5-4577-b1d6-6eadc5d9ac23 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:30.859081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289727e-5d3e-4d51-b15b-5952df107a7a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:30.891995 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967fd28-b955-42ff-bc9c-7d8be5068fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:30.892863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967fd28-b955-42ff-bc9c-7d8be5068fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:30.893333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967fd28-b955-42ff-bc9c-7d8be5068fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:30.893605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967fd28-b955-42ff-bc9c-7d8be5068fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:30.894227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eefd6d-465a-4bde-b473-ad60508f1747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:30.894409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967fd28-b955-42ff-bc9c-7d8be5068fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:30.894649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967fd28-b955-42ff-bc9c-7d8be5068fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:30.895057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eefd6d-465a-4bde-b473-ad60508f1747 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:30.895330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eefd6d-465a-4bde-b473-ad60508f1747 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:30.895596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eefd6d-465a-4bde-b473-ad60508f1747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:30.896029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967fd28-b955-42ff-bc9c-7d8be5068fd5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:30.906526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eefd6d-465a-4bde-b473-ad60508f1747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:30.908038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 252/516] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:30.908161 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eefd6d-465a-4bde-b473-ad60508f1747 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:30.908821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967fd28-b955-42ff-bc9c-7d8be5068fd5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-32eefd6d-465a-4bde-b473-ad60508f1747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:30.925816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:30.926785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:30.927641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:30.927641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:30.927641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:30.927641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:30.927641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 265/517] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:30.927907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eefd6d-465a-4bde-b473-ad60508f1747 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:31.010240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967fd28-b955-42ff-bc9c-7d8be5068fd5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:31.023215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:31.030326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eefd6d-465a-4bde-b473-ad60508f1747 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:31.032708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:31.045120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ab3b7-276c-49c1-9a08-117d5b48c2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:31.045120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ab3b7-276c-49c1-9a08-117d5b48c2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:31.045426 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ab3b7-276c-49c1-9a08-117d5b48c2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:31.045700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ab3b7-276c-49c1-9a08-117d5b48c2b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:31.046462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ab3b7-276c-49c1-9a08-117d5b48c2b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:31.046789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ab3b7-276c-49c1-9a08-117d5b48c2b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:31.048389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ab3b7-276c-49c1-9a08-117d5b48c2b5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:31.061307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 253/518] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:31.061307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ab3b7-276c-49c1-9a08-117d5b48c2b5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:31.069896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b626e4-3680-436d-875a-ecee6d9e6962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:31.070738 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b626e4-3680-436d-875a-ecee6d9e6962 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:31.071014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b626e4-3680-436d-875a-ecee6d9e6962 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:31.071281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b626e4-3680-436d-875a-ecee6d9e6962 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:31.079450 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b626e4-3680-436d-875a-ecee6d9e6962 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:31.081008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b626e4-3680-436d-875a-ecee6d9e6962 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-45b626e4-3680-436d-875a-ecee6d9e6962 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:31.096044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:31.097116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:31.097998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:31.097998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:31.097998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:31.097998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:31.097998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:31.097998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:31.097998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:31.097998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:31.097998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 03:04:31.097998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:31.097998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 266/519] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:31.098599 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b626e4-3680-436d-875a-ecee6d9e6962 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:31.178422 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ab3b7-276c-49c1-9a08-117d5b48c2b5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:31.203299 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b626e4-3680-436d-875a-ecee6d9e6962 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:31.212365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644f82b-9090-40d3-a893-419a14e72c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:31.213024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f82b-9090-40d3-a893-419a14e72c9f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:31.213320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f82b-9090-40d3-a893-419a14e72c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:31.213592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f82b-9090-40d3-a893-419a14e72c9f None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:31.214484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644f82b-9090-40d3-a893-419a14e72c9f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:31.214783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644f82b-9090-40d3-a893-419a14e72c9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:31.216254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644f82b-9090-40d3-a893-419a14e72c9f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:31.233695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 254/520] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Jun 28 03:04:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:31.234554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644f82b-9090-40d3-a893-419a14e72c9f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:31.236758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cba13f-49a9-44de-8868-108d12a8be49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:31.237573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cba13f-49a9-44de-8868-108d12a8be49 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:31.237854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cba13f-49a9-44de-8868-108d12a8be49 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:31.238119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cba13f-49a9-44de-8868-108d12a8be49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:31.245936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cba13f-49a9-44de-8868-108d12a8be49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:31.247443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cba13f-49a9-44de-8868-108d12a8be49 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-80cba13f-49a9-44de-8868-108d12a8be49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:31.262855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:31.263753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:31.264587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:31.264587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:31.264587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:31.264587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:31.264587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:31.264587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:31.264587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:31.264587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:31.264587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 267/521] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:31.265048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cba13f-49a9-44de-8868-108d12a8be49 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:31.269107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:31.289813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:31.339044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644f82b-9090-40d3-a893-419a14e72c9f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:31.364537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cba13f-49a9-44de-8868-108d12a8be49 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:31.373295 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95061972-4343-4ffb-a5e0-119ac05f9d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:31.374010 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95061972-4343-4ffb-a5e0-119ac05f9d3d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:31.374681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95061972-4343-4ffb-a5e0-119ac05f9d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:31.374954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95061972-4343-4ffb-a5e0-119ac05f9d3d None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:31.375663 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95061972-4343-4ffb-a5e0-119ac05f9d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:31.376331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95061972-4343-4ffb-a5e0-119ac05f9d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:31.377739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95061972-4343-4ffb-a5e0-119ac05f9d3d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:31.388785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 255/522] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:31.389550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95061972-4343-4ffb-a5e0-119ac05f9d3d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:31.400763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c4659-5d37-4979-877d-0aecefd2b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:31.401436 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c4659-5d37-4979-877d-0aecefd2b7b5 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:31.401713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c4659-5d37-4979-877d-0aecefd2b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:31.401979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c4659-5d37-4979-877d-0aecefd2b7b5 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:31.402713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c4659-5d37-4979-877d-0aecefd2b7b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:31.404142 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c4659-5d37-4979-877d-0aecefd2b7b5 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:31.427032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 268/523] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:04:31 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:04:31.427864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c4659-5d37-4979-877d-0aecefd2b7b5 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:31.490094 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:31.502595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95061972-4343-4ffb-a5e0-119ac05f9d3d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:31.524667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:31.541274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12475c4-6eaa-4173-8553-24527857e2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:31.541998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12475c4-6eaa-4173-8553-24527857e2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:31.542279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12475c4-6eaa-4173-8553-24527857e2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:31.542586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12475c4-6eaa-4173-8553-24527857e2e4 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:31.543448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12475c4-6eaa-4173-8553-24527857e2e4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:31.543774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12475c4-6eaa-4173-8553-24527857e2e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:31.545237 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12475c4-6eaa-4173-8553-24527857e2e4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:31.549747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c4659-5d37-4979-877d-0aecefd2b7b5 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:31.564664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 256/524] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Jun 28 03:04:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:31.565532 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12475c4-6eaa-4173-8553-24527857e2e4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:31.595930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81b6c2-c665-4186-b458-3d7caface783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:31.596547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81b6c2-c665-4186-b458-3d7caface783 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:31.596823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81b6c2-c665-4186-b458-3d7caface783 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:31.597565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81b6c2-c665-4186-b458-3d7caface783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:31.679096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81b6c2-c665-4186-b458-3d7caface783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:31.680720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81b6c2-c665-4186-b458-3d7caface783 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:31.685626 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12475c4-6eaa-4173-8553-24527857e2e4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:31.730374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73db2ae-6a89-41f2-bb5a-d3ffd045560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:31.731452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db2ae-6a89-41f2-bb5a-d3ffd045560d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:31.731712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db2ae-6a89-41f2-bb5a-d3ffd045560d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:31.732008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db2ae-6a89-41f2-bb5a-d3ffd045560d None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:31.732809 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73db2ae-6a89-41f2-bb5a-d3ffd045560d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:31.733118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73db2ae-6a89-41f2-bb5a-d3ffd045560d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:31.735401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73db2ae-6a89-41f2-bb5a-d3ffd045560d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:31.760059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 257/525] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:31.760856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73db2ae-6a89-41f2-bb5a-d3ffd045560d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:31.767147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:31.772922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:31.794879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 269/526] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:31.794879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81b6c2-c665-4186-b458-3d7caface783 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:31.873803 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73db2ae-6a89-41f2-bb5a-d3ffd045560d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:31.897516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81b6c2-c665-4186-b458-3d7caface783 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:31.912709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfef40-d635-423e-8d67-20bfa6375480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:31.913844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfef40-d635-423e-8d67-20bfa6375480 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:31.914320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfef40-d635-423e-8d67-20bfa6375480 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:31.914916 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfef40-d635-423e-8d67-20bfa6375480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:31.922599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfef40-d635-423e-8d67-20bfa6375480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:31.924124 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfef40-d635-423e-8d67-20bfa6375480 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:31.934024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a5b2f-5aa6-4762-8704-bf33adfbdca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:31.934718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a5b2f-5aa6-4762-8704-bf33adfbdca0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:31.935002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a5b2f-5aa6-4762-8704-bf33adfbdca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:31.935272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a5b2f-5aa6-4762-8704-bf33adfbdca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-68cfef40-d635-423e-8d67-20bfa6375480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:31.940082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:31.940903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:31.941735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:31.941735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:31.941735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:31.941735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:31.941735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:31.941735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:31.941735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:31.941735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:31.941735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 258/527] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:31.942675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfef40-d635-423e-8d67-20bfa6375480 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:31.992262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:32.013116 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:32.013596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a5b2f-5aa6-4762-8704-bf33adfbdca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:32.014961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a5b2f-5aa6-4762-8704-bf33adfbdca0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:32.052768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfef40-d635-423e-8d67-20bfa6375480 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:32.091108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9218c5-2c60-4274-94a6-fb1e5a5ba4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:32.091773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9218c5-2c60-4274-94a6-fb1e5a5ba4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:32.092046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9218c5-2c60-4274-94a6-fb1e5a5ba4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:32.092315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9218c5-2c60-4274-94a6-fb1e5a5ba4c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:32.093150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9218c5-2c60-4274-94a6-fb1e5a5ba4c1 None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=70604923ae0b4a4dae21de1314cddbf6) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:32.093457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9218c5-2c60-4274-94a6-fb1e5a5ba4c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:32.095085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9218c5-2c60-4274-94a6-fb1e5a5ba4c1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:32.106339 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 259/528] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:31 2022] GET /identity/v3/role_assignments?user.id=70604923ae0b4a4dae21de1314cddbf6&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:32.106339 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9218c5-2c60-4274-94a6-fb1e5a5ba4c1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:32.145081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 270/529] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:32.146147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a5b2f-5aa6-4762-8704-bf33adfbdca0 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:32.210488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9218c5-2c60-4274-94a6-fb1e5a5ba4c1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:32.249796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:32.254220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d582465-568e-4b8d-a1a6-63bb37750ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:32.255414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d582465-568e-4b8d-a1a6-63bb37750ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:32.255687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d582465-568e-4b8d-a1a6-63bb37750ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:32.255953 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d582465-568e-4b8d-a1a6-63bb37750ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:32.269834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:32.276180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d582465-568e-4b8d-a1a6-63bb37750ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:32.278791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d582465-568e-4b8d-a1a6-63bb37750ee3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:32.296874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a5b2f-5aa6-4762-8704-bf33adfbdca0 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-4d582465-568e-4b8d-a1a6-63bb37750ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:32.298886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:32.299713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:32.300552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:32.300552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:32.300552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:32.300552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:32.300552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 260/530] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:32.301429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d582465-568e-4b8d-a1a6-63bb37750ee3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:32.343934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f2a3c-644a-4d14-a71f-be5f5881b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:32.344600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2a3c-644a-4d14-a71f-be5f5881b0cd None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:32.344963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2a3c-644a-4d14-a71f-be5f5881b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:32.345761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2a3c-644a-4d14-a71f-be5f5881b0cd None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:32.346600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f2a3c-644a-4d14-a71f-be5f5881b0cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:32.346897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f2a3c-644a-4d14-a71f-be5f5881b0cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:32.348776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f2a3c-644a-4d14-a71f-be5f5881b0cd None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:32.373406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 271/531] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:32.374939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f2a3c-644a-4d14-a71f-be5f5881b0cd None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:32.415335 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d582465-568e-4b8d-a1a6-63bb37750ee3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:32.456097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb706ed6-0f96-42f0-9608-357d8d99ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:32.457017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb706ed6-0f96-42f0-9608-357d8d99ba88 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:32.457347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb706ed6-0f96-42f0-9608-357d8d99ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:32.457683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb706ed6-0f96-42f0-9608-357d8d99ba88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:32.469489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb706ed6-0f96-42f0-9608-357d8d99ba88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:32.471310 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb706ed6-0f96-42f0-9608-357d8d99ba88 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-cb706ed6-0f96-42f0-9608-357d8d99ba88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:32.491808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:32.492859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:32.493689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:32.493689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:32.493689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:32.493689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:32.493689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 261/532] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:32.494713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb706ed6-0f96-42f0-9608-357d8d99ba88 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:32.504962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f2a3c-644a-4d14-a71f-be5f5881b0cd None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:32.534938 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:32.547064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f045a0-d9d1-4f34-927a-49b0d31c392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:32.548145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f045a0-d9d1-4f34-927a-49b0d31c392c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:32.548594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f045a0-d9d1-4f34-927a-49b0d31c392c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:32.549049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f045a0-d9d1-4f34-927a-49b0d31c392c None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:32.549921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f045a0-d9d1-4f34-927a-49b0d31c392c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:32.550411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f045a0-d9d1-4f34-927a-49b0d31c392c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:32.552151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f045a0-d9d1-4f34-927a-49b0d31c392c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:32.562247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:32.566464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 272/533] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:32.567816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f045a0-d9d1-4f34-927a-49b0d31c392c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:32.609179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb706ed6-0f96-42f0-9608-357d8d99ba88 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:32.645996 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3dee6-bf8e-456e-b8d7-f82f76a1434d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:32.646491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3dee6-bf8e-456e-b8d7-f82f76a1434d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:32.646768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3dee6-bf8e-456e-b8d7-f82f76a1434d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:32.647038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3dee6-bf8e-456e-b8d7-f82f76a1434d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:32.647869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3dee6-bf8e-456e-b8d7-f82f76a1434d None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=b1868e9d8b004c4fb781e532c775428e) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:32.648180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3dee6-bf8e-456e-b8d7-f82f76a1434d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:32.649624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3dee6-bf8e-456e-b8d7-f82f76a1434d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:32.656093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 262/534] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:32 2022] GET /identity/v3/role_assignments?user.id=b1868e9d8b004c4fb781e532c775428e&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:32.656962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3dee6-bf8e-456e-b8d7-f82f76a1434d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:32.705149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f045a0-d9d1-4f34-927a-49b0d31c392c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:32.764127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:32.769111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3dee6-bf8e-456e-b8d7-f82f76a1434d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:32.771097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250488bf-fe29-450d-a588-2d3874056ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:32.771789 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250488bf-fe29-450d-a588-2d3874056ffe None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:32.772072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250488bf-fe29-450d-a588-2d3874056ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:32.772345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250488bf-fe29-450d-a588-2d3874056ffe None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:32.773148 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250488bf-fe29-450d-a588-2d3874056ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:32.773464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250488bf-fe29-450d-a588-2d3874056ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:32.774962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250488bf-fe29-450d-a588-2d3874056ffe None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:32.794409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 273/535] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:32.801152 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250488bf-fe29-450d-a588-2d3874056ffe None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:32.806612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446c16a-5657-44a5-9fcf-8a4ee939e131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:32.807405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446c16a-5657-44a5-9fcf-8a4ee939e131 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:32.807682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446c16a-5657-44a5-9fcf-8a4ee939e131 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:32.807952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446c16a-5657-44a5-9fcf-8a4ee939e131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:32.815929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446c16a-5657-44a5-9fcf-8a4ee939e131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:32.817504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446c16a-5657-44a5-9fcf-8a4ee939e131 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-7446c16a-5657-44a5-9fcf-8a4ee939e131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:32.833479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:32.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:32.835245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:32.835245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:32.835245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:32.835245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:32.835245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:32.835245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:32.835245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:32.835245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:32.835245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 263/536] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:32.842503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446c16a-5657-44a5-9fcf-8a4ee939e131 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:32.944070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:33.018332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250488bf-fe29-450d-a588-2d3874056ffe None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:33.048740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446c16a-5657-44a5-9fcf-8a4ee939e131 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:33.085665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d1029-94c5-41c4-a46a-e5d9e354aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:33.086520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d1029-94c5-41c4-a46a-e5d9e354aab3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:33.086822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d1029-94c5-41c4-a46a-e5d9e354aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:33.087163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d1029-94c5-41c4-a46a-e5d9e354aab3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:33.098604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f7d3f-e9fc-4f00-aa16-0df3349f5702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:33.099280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f7d3f-e9fc-4f00-aa16-0df3349f5702 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:33.099551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f7d3f-e9fc-4f00-aa16-0df3349f5702 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:33.099818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f7d3f-e9fc-4f00-aa16-0df3349f5702 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:33.100606 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f7d3f-e9fc-4f00-aa16-0df3349f5702 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:33.100907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f7d3f-e9fc-4f00-aa16-0df3349f5702 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:33.102238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d1029-94c5-41c4-a46a-e5d9e354aab3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:33.102513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f7d3f-e9fc-4f00-aa16-0df3349f5702 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:33.103731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d1029-94c5-41c4-a46a-e5d9e354aab3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:33.115976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 264/537] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-7a1d1029-94c5-41c4-a46a-e5d9e354aab3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:33.127019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:33.127994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:33.128825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:33.128825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:33.128825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:33.128825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:33.128825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:33.128825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:33.128825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:33.128825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:33.129712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f7d3f-e9fc-4f00-aa16-0df3349f5702 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:33.140524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 274/538] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:33.141499 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d1029-94c5-41c4-a46a-e5d9e354aab3 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:33.174326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:33.253757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d1029-94c5-41c4-a46a-e5d9e354aab3 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:33.284446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:33.291063 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acc14f-18f7-48d6-98a5-4e7aadb69f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:33.291802 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acc14f-18f7-48d6-98a5-4e7aadb69f0d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:33.292079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acc14f-18f7-48d6-98a5-4e7aadb69f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:33.292443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acc14f-18f7-48d6-98a5-4e7aadb69f0d None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:33.293781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acc14f-18f7-48d6-98a5-4e7aadb69f0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:33.294092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acc14f-18f7-48d6-98a5-4e7aadb69f0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:33.295823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acc14f-18f7-48d6-98a5-4e7aadb69f0d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:33.309124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 275/539] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:33.331090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acc14f-18f7-48d6-98a5-4e7aadb69f0d None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:33.352861 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f7d3f-e9fc-4f00-aa16-0df3349f5702 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:33.387943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cad338-bd4f-48ab-8cb1-f6cfa8753e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:33.388970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cad338-bd4f-48ab-8cb1-f6cfa8753e3f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:33.389473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cad338-bd4f-48ab-8cb1-f6cfa8753e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:33.389940 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cad338-bd4f-48ab-8cb1-f6cfa8753e3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:33.391011 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cad338-bd4f-48ab-8cb1-f6cfa8753e3f None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=0f8a5bc11b6745a196337b4dc48de14e) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:33.391520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cad338-bd4f-48ab-8cb1-f6cfa8753e3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:33.393352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cad338-bd4f-48ab-8cb1-f6cfa8753e3f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:33.399791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 265/540] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:33 2022] GET /identity/v3/role_assignments?user.id=0f8a5bc11b6745a196337b4dc48de14e&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:33.520696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acc14f-18f7-48d6-98a5-4e7aadb69f0d None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:33.540899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2687f-739b-4898-aab3-86a3151362ac None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:33.541224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2687f-739b-4898-aab3-86a3151362ac None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:33.541558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2687f-739b-4898-aab3-86a3151362ac None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:33.543239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 266/541] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:04:33.549109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d76bf-8d3a-4d1e-a38c-bdf5df6077d2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:33.549399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d76bf-8d3a-4d1e-a38c-bdf5df6077d2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:33.549679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d76bf-8d3a-4d1e-a38c-bdf5df6077d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:33.566812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059b79f-3593-439a-a4f1-6e56940d8f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:33.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b79f-3593-439a-a4f1-6e56940d8f78 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:33.567686 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b79f-3593-439a-a4f1-6e56940d8f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:33.567952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b79f-3593-439a-a4f1-6e56940d8f78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:33.568611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-515d76bf-8d3a-4d1e-a38c-bdf5df6077d2 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:33.568792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059b79f-3593-439a-a4f1-6e56940d8f78 None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=d7e0632bc12346b38663a0ef97ab1a99) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:33.569101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059b79f-3593-439a-a4f1-6e56940d8f78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:33.570365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-515d76bf-8d3a-4d1e-a38c-bdf5df6077d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:33.570656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059b79f-3593-439a-a4f1-6e56940d8f78 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:33.577818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 276/542] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:33 2022] GET /identity/v3/role_assignments?user.id=d7e0632bc12346b38663a0ef97ab1a99&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:33.676124 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 267/543] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:33.709562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059b79f-3593-439a-a4f1-6e56940d8f78 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:33.773425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:33.843673 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059b79f-3593-439a-a4f1-6e56940d8f78 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:33.893830 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adb559-1499-48c5-be7e-b83bf091b0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:33.894967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb559-1499-48c5-be7e-b83bf091b0ad None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:33.895407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb559-1499-48c5-be7e-b83bf091b0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:33.895819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adb559-1499-48c5-be7e-b83bf091b0ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:33.906527 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adb559-1499-48c5-be7e-b83bf091b0ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-52adb559-1499-48c5-be7e-b83bf091b0ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:33.922826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:33.923857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:33.924867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 277/544] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:33.931490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d76bf-8d3a-4d1e-a38c-bdf5df6077d2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:33.957383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:34.073214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d76bf-8d3a-4d1e-a38c-bdf5df6077d2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:34.108213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5004a-e3d3-4f1a-8221-104d2f250020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:34.108818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5004a-e3d3-4f1a-8221-104d2f250020 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:34.109098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5004a-e3d3-4f1a-8221-104d2f250020 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:34.109371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5004a-e3d3-4f1a-8221-104d2f250020 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:34.110131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5004a-e3d3-4f1a-8221-104d2f250020 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:34.110497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5004a-e3d3-4f1a-8221-104d2f250020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:34.111982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5004a-e3d3-4f1a-8221-104d2f250020 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:34.121139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 268/545] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:34.127492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adb559-1499-48c5-be7e-b83bf091b0ad None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:34.260581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adb559-1499-48c5-be7e-b83bf091b0ad None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:34.267980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:34.320284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3f378-70c4-4364-8fdf-7bd7feb54e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:34.321106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3f378-70c4-4364-8fdf-7bd7feb54e9e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:34.321396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3f378-70c4-4364-8fdf-7bd7feb54e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:34.321671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3f378-70c4-4364-8fdf-7bd7feb54e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:34.342139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3f378-70c4-4364-8fdf-7bd7feb54e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:34.343658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3f378-70c4-4364-8fdf-7bd7feb54e9e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-94a3f378-70c4-4364-8fdf-7bd7feb54e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:34.365991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:34.366883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:34.367718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:34.367718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:34.367718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:34.367718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:34.367718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 278/546] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:34.375416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5004a-e3d3-4f1a-8221-104d2f250020 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:34.475874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:34.504876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265beda-bffc-4ec7-8cd0-374c66866ff1 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:34.505178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265beda-bffc-4ec7-8cd0-374c66866ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:34.505436 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265beda-bffc-4ec7-8cd0-374c66866ff1 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:34.507424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 279/547] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:34.512503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5004a-e3d3-4f1a-8221-104d2f250020 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:34.512697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64d04-5d69-43b7-ba80-a6b1ffadfd68 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:34.512935 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64d04-5d69-43b7-ba80-a6b1ffadfd68 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:34.513213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64d04-5d69-43b7-ba80-a6b1ffadfd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:34.532956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-d8b64d04-5d69-43b7-ba80-a6b1ffadfd68 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:34.534609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d8b64d04-5d69-43b7-ba80-a6b1ffadfd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:34.568820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10465958-25b1-4c35-b160-18676bcc4c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:34.569939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10465958-25b1-4c35-b160-18676bcc4c8a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:34.570449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10465958-25b1-4c35-b160-18676bcc4c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:34.570919 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10465958-25b1-4c35-b160-18676bcc4c8a None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:34.571887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10465958-25b1-4c35-b160-18676bcc4c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:34.572398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10465958-25b1-4c35-b160-18676bcc4c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:34.573969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10465958-25b1-4c35-b160-18676bcc4c8a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:34.596596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 269/548] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:34.603283 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10465958-25b1-4c35-b160-18676bcc4c8a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:34.642577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 280/549] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:34.665121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b64d04-5d69-43b7-ba80-a6b1ffadfd68 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:34.773562 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10465958-25b1-4c35-b160-18676bcc4c8a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:34.827971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:34.839060 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3857d-a951-427a-9cfd-ec44bfe8c8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:34.839887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3857d-a951-427a-9cfd-ec44bfe8c8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:34.840170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3857d-a951-427a-9cfd-ec44bfe8c8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:34.840445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3857d-a951-427a-9cfd-ec44bfe8c8c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:34.846634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:34.856757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b64d04-5d69-43b7-ba80-a6b1ffadfd68 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:34.860959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3857d-a951-427a-9cfd-ec44bfe8c8c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:34.866316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3857d-a951-427a-9cfd-ec44bfe8c8c0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-67a3857d-a951-427a-9cfd-ec44bfe8c8c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:34.891187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:34.892835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:34.893932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:34.893932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:34.893932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:34.893932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:34.893932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:34.893932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:34.893932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:34.893932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:34.893932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:04:34.893932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:34.907863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 270/550] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:34.911302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe1745-e257-40bd-b32e-d58cac8bce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:34.912392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3857d-a951-427a-9cfd-ec44bfe8c8c0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:34.913793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe1745-e257-40bd-b32e-d58cac8bce94 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:34.914655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe1745-e257-40bd-b32e-d58cac8bce94 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:34.918809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe1745-e257-40bd-b32e-d58cac8bce94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:34.941377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe1745-e257-40bd-b32e-d58cac8bce94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-15fe1745-e257-40bd-b32e-d58cac8bce94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:34.957706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:34.958696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:34.959502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:34.966991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 281/551] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:34.971367 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe1745-e257-40bd-b32e-d58cac8bce94 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:35.075799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3857d-a951-427a-9cfd-ec44bfe8c8c0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:35.114991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4935e7-fce1-4f54-92d3-8e3871148392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:35.116856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4935e7-fce1-4f54-92d3-8e3871148392 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:35.117365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4935e7-fce1-4f54-92d3-8e3871148392 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:35.117835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4935e7-fce1-4f54-92d3-8e3871148392 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:35.118915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4935e7-fce1-4f54-92d3-8e3871148392 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:35.119421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4935e7-fce1-4f54-92d3-8e3871148392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:35.121092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4935e7-fce1-4f54-92d3-8e3871148392 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:35.140365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 271/552] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Jun 28 03:04:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:35.145895 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4935e7-fce1-4f54-92d3-8e3871148392 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:35.205782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe1745-e257-40bd-b32e-d58cac8bce94 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:35.214693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:35.250479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4935e7-fce1-4f54-92d3-8e3871148392 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:35.285924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e3f0-dd59-480c-ab7e-f1f3a300f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:35.287008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e3f0-dd59-480c-ab7e-f1f3a300f2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:35.287490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e3f0-dd59-480c-ab7e-f1f3a300f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:35.287957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e3f0-dd59-480c-ab7e-f1f3a300f2c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:35.292569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41ff05-3036-48e8-b70d-c318e13b8301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:35.293254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41ff05-3036-48e8-b70d-c318e13b8301 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:35.293530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41ff05-3036-48e8-b70d-c318e13b8301 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:35.293790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41ff05-3036-48e8-b70d-c318e13b8301 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:35.294587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41ff05-3036-48e8-b70d-c318e13b8301 None admin] RBAC: Adding query filter params (name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:35.294891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41ff05-3036-48e8-b70d-c318e13b8301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:35.296280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41ff05-3036-48e8-b70d-c318e13b8301 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:35.328707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 282/553] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:35.339288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41ff05-3036-48e8-b70d-c318e13b8301 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:35.356956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:35.362846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905e3f0-dd59-480c-ab7e-f1f3a300f2c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:35.364726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905e3f0-dd59-480c-ab7e-f1f3a300f2c5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:35.427976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:35.479753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 272/554] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:35.482092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee2b8c-338e-4a12-b99a-ec0bd95f319f None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:35.482592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee2b8c-338e-4a12-b99a-ec0bd95f319f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:35.483027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee2b8c-338e-4a12-b99a-ec0bd95f319f None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:35.484688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 273/555] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:35.487038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee2b8c-338e-4a12-b99a-ec0bd95f319f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:35.496136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41ff05-3036-48e8-b70d-c318e13b8301 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:35.531831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56399300-d87b-40a1-88f3-045991941132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:35.533236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399300-d87b-40a1-88f3-045991941132 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:35.533694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399300-d87b-40a1-88f3-045991941132 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:35.534255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399300-d87b-40a1-88f3-045991941132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:35.546701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56399300-d87b-40a1-88f3-045991941132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:35.548607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56399300-d87b-40a1-88f3-045991941132 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-56399300-d87b-40a1-88f3-045991941132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:35.567410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:35.568319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:35.569183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:35.569183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:35.569183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:35.569183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:35.571583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 283/556] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:35.573119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4affde-2ef9-4c01-8954-8a458a02b1ee None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:35.573598 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4affde-2ef9-4c01-8954-8a458a02b1ee None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:35.574059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4affde-2ef9-4c01-8954-8a458a02b1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:35.592564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8c4affde-2ef9-4c01-8954-8a458a02b1ee None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:35.594233 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8c4affde-2ef9-4c01-8954-8a458a02b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:35.618508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee2b8c-338e-4a12-b99a-ec0bd95f319f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:35.657175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:35.665306 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ba82-1abb-4801-80b5-aa19b9fa0643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:35.666417 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ba82-1abb-4801-80b5-aa19b9fa0643 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:35.666704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ba82-1abb-4801-80b5-aa19b9fa0643 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:35.666979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ba82-1abb-4801-80b5-aa19b9fa0643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:35.678587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ba82-1abb-4801-80b5-aa19b9fa0643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:35.678859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 284/557] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:35.680005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ba82-1abb-4801-80b5-aa19b9fa0643 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:35.680266 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4affde-2ef9-4c01-8954-8a458a02b1ee None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-5949ba82-1abb-4801-80b5-aa19b9fa0643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:35.701159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:35.702826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:35.703903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:35.703903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:35.703903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:35.703903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:35.707677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 274/558] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:35.711259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ba82-1abb-4801-80b5-aa19b9fa0643 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:35.722500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:35.823870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4affde-2ef9-4c01-8954-8a458a02b1ee None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:35.838405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ba82-1abb-4801-80b5-aa19b9fa0643 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:35.862021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfd762-becf-4cb0-afd4-b6ad6751d91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:35.862745 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfd762-becf-4cb0-afd4-b6ad6751d91e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:35.863028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfd762-becf-4cb0-afd4-b6ad6751d91e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:35.863302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfd762-becf-4cb0-afd4-b6ad6751d91e None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:35.864093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfd762-becf-4cb0-afd4-b6ad6751d91e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:35.864366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfd762-becf-4cb0-afd4-b6ad6751d91e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:35.866119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfd762-becf-4cb0-afd4-b6ad6751d91e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:35.877210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6db884-4274-4ee5-899d-230ee8271e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:35.877560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 285/559] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:35.878435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfd762-becf-4cb0-afd4-b6ad6751d91e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:35.878916 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db884-4274-4ee5-899d-230ee8271e0f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:35.879243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db884-4274-4ee5-899d-230ee8271e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:35.879556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db884-4274-4ee5-899d-230ee8271e0f None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:35.880396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6db884-4274-4ee5-899d-230ee8271e0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:35.880701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6db884-4274-4ee5-899d-230ee8271e0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:35.882315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6db884-4274-4ee5-899d-230ee8271e0f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:35.896446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 275/560] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:35.897703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b844d-cf35-45e1-8f91-9cf1f41d6774 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:35.897991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b844d-cf35-45e1-8f91-9cf1f41d6774 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:35.898264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b844d-cf35-45e1-8f91-9cf1f41d6774 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:35.899798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 276/561] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:35.900340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b844d-cf35-45e1-8f91-9cf1f41d6774 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:35.943407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:35.971480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:35.996750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfd762-becf-4cb0-afd4-b6ad6751d91e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.007899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b844d-cf35-45e1-8f91-9cf1f41d6774 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.031073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c79f4-47a7-464d-a5ce-4f2824389f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:36.031893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c79f4-47a7-464d-a5ce-4f2824389f88 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.032309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c79f4-47a7-464d-a5ce-4f2824389f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.032581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c79f4-47a7-464d-a5ce-4f2824389f88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.042711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c79f4-47a7-464d-a5ce-4f2824389f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:36.043224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36884f2f-01e0-4b7a-8ca8-1424d57532d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:36.044037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36884f2f-01e0-4b7a-8ca8-1424d57532d4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.044315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36884f2f-01e0-4b7a-8ca8-1424d57532d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.044583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36884f2f-01e0-4b7a-8ca8-1424d57532d4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-f60c79f4-47a7-464d-a5ce-4f2824389f88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:36.051570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:36.052653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:36.053528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:36.054177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36884f2f-01e0-4b7a-8ca8-1424d57532d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:36.054249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 286/562] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:36.054635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36884f2f-01e0-4b7a-8ca8-1424d57532d4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:36.054810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c79f4-47a7-464d-a5ce-4f2824389f88 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-36884f2f-01e0-4b7a-8ca8-1424d57532d4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:36.072465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:36.073509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:36.074500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:36.074500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:36.074500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:36.074500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:36.074500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:36.074500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:36.074500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:36.074500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:36.074500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 28 03:04:36.074500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:36.074500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 277/563] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:36.075108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b254dbc-6ffd-42bc-8699-9d006da5a990 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.075177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b254dbc-6ffd-42bc-8699-9d006da5a990 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.075503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b254dbc-6ffd-42bc-8699-9d006da5a990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.092202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8b254dbc-6ffd-42bc-8699-9d006da5a990 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:36.093385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8b254dbc-6ffd-42bc-8699-9d006da5a990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:36.158902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 278/564] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:36.160339 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbd8ac-0745-42b6-8e13-0da4e26ee820 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.160627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbd8ac-0745-42b6-8e13-0da4e26ee820 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.160868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbd8ac-0745-42b6-8e13-0da4e26ee820 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.161304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c79f4-47a7-464d-a5ce-4f2824389f88 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.162315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 279/565] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:36.166998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbd8ac-0745-42b6-8e13-0da4e26ee820 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:36.172464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:36.199548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17eb36-b50f-4d77-8557-80fcd2ad8460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:36.200278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17eb36-b50f-4d77-8557-80fcd2ad8460 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.200556 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17eb36-b50f-4d77-8557-80fcd2ad8460 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.200822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17eb36-b50f-4d77-8557-80fcd2ad8460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.207790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17eb36-b50f-4d77-8557-80fcd2ad8460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:36.209236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17eb36-b50f-4d77-8557-80fcd2ad8460 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-6d17eb36-b50f-4d77-8557-80fcd2ad8460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:36.223211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:36.224110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:36.225020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:36.225020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:36.225020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:36.225020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:36.225020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:36.225020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:36.225020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:36.225020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:36.225481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:36.225555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 287/566] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:36.225555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17eb36-b50f-4d77-8557-80fcd2ad8460 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:36.270310 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbd8ac-0745-42b6-8e13-0da4e26ee820 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.303927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48934560-7d2b-4d79-8f5c-a571b39fd2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:36.304596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48934560-7d2b-4d79-8f5c-a571b39fd2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.304871 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48934560-7d2b-4d79-8f5c-a571b39fd2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.305137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48934560-7d2b-4d79-8f5c-a571b39fd2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.305881 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48934560-7d2b-4d79-8f5c-a571b39fd2b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:36.306186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48934560-7d2b-4d79-8f5c-a571b39fd2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:36.307936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48934560-7d2b-4d79-8f5c-a571b39fd2b9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:36.317165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 280/567] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:36.318439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1827c13-d2ae-4f9a-b6a9-b62a7ec0133d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.318726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1827c13-d2ae-4f9a-b6a9-b62a7ec0133d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.319000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1827c13-d2ae-4f9a-b6a9-b62a7ec0133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.334608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17eb36-b50f-4d77-8557-80fcd2ad8460 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.335816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e1827c13-d2ae-4f9a-b6a9-b62a7ec0133d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:36.337074 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e1827c13-d2ae-4f9a-b6a9-b62a7ec0133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:36.370048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7825981-328f-41f7-80ae-f70e732a3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:36.370762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825981-328f-41f7-80ae-f70e732a3aef None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.371039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825981-328f-41f7-80ae-f70e732a3aef None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.371288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825981-328f-41f7-80ae-f70e732a3aef None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.372150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7825981-328f-41f7-80ae-f70e732a3aef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:36.372443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7825981-328f-41f7-80ae-f70e732a3aef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:36.373869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7825981-328f-41f7-80ae-f70e732a3aef None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:36.391466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 288/568] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Jun 28 03:04:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:36.392661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7825981-328f-41f7-80ae-f70e732a3aef None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:36.407273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 281/569] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:36.408146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1827c13-d2ae-4f9a-b6a9-b62a7ec0133d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:36.421352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:36.461954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:36.496368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7825981-328f-41f7-80ae-f70e732a3aef None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.513773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1827c13-d2ae-4f9a-b6a9-b62a7ec0133d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.530909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f5828-a41b-4af2-a35f-5be412c5073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:36.531948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f5828-a41b-4af2-a35f-5be412c5073f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.532278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f5828-a41b-4af2-a35f-5be412c5073f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.532558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f5828-a41b-4af2-a35f-5be412c5073f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.542573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f5828-a41b-4af2-a35f-5be412c5073f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:36.548336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c8afb-2af9-4702-8a96-233d950b965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:36.549032 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8afb-2af9-4702-8a96-233d950b965a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.549313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8afb-2af9-4702-8a96-233d950b965a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.549587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8afb-2af9-4702-8a96-233d950b965a None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-7c5f5828-a41b-4af2-a35f-5be412c5073f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:36.550341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:36.551408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:36.552295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:36.552934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c8afb-2af9-4702-8a96-233d950b965a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:36.552934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c8afb-2af9-4702-8a96-233d950b965a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:36.553058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 289/570] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:36.553125 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c8afb-2af9-4702-8a96-233d950b965a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:36.553205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f5828-a41b-4af2-a35f-5be412c5073f None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:36.564691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 282/571] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:36.565563 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c8afb-2af9-4702-8a96-233d950b965a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:36.639567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:36.651866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f5828-a41b-4af2-a35f-5be412c5073f None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.663795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c8afb-2af9-4702-8a96-233d950b965a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.672701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:36.686524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37d0e-fe5c-45c3-a9e1-7d4c816a651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:36.687429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37d0e-fe5c-45c3-a9e1-7d4c816a651e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.687715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37d0e-fe5c-45c3-a9e1-7d4c816a651e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.687987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37d0e-fe5c-45c3-a9e1-7d4c816a651e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.698636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb37d0e-fe5c-45c3-a9e1-7d4c816a651e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:36.698929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e23a4-cc82-4d0f-af5b-f038a4b5e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:36.699730 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e23a4-cc82-4d0f-af5b-f038a4b5e9ac None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.700007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e23a4-cc82-4d0f-af5b-f038a4b5e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.700101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb37d0e-fe5c-45c3-a9e1-7d4c816a651e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:36.700276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e23a4-cc82-4d0f-af5b-f038a4b5e9ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.710903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e23a4-cc82-4d0f-af5b-f038a4b5e9ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:36.712404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e23a4-cc82-4d0f-af5b-f038a4b5e9ac None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-fbb37d0e-fe5c-45c3-a9e1-7d4c816a651e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:36.716868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:36.717989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:36.718996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:36.718996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:36.718996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:36.718996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:36.718996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 290/572] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:36.718996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37d0e-fe5c-45c3-a9e1-7d4c816a651e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-177e23a4-cc82-4d0f-af5b-f038a4b5e9ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:36.735653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:36.736875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:36.737746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:36.737746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:36.737746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:36.737746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:36.737746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 283/573] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:36.737746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e23a4-cc82-4d0f-af5b-f038a4b5e9ac None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:36.825855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37d0e-fe5c-45c3-a9e1-7d4c816a651e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.834607 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e23a4-cc82-4d0f-af5b-f038a4b5e9ac None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.861485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dd28f-c95f-4625-9d4c-15514424ee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:36.862319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dd28f-c95f-4625-9d4c-15514424ee59 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.862607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dd28f-c95f-4625-9d4c-15514424ee59 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.862877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dd28f-c95f-4625-9d4c-15514424ee59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.869504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419c8f1-89b2-4d04-9667-6bc4474cd169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:36.870176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419c8f1-89b2-4d04-9667-6bc4474cd169 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:36.870483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419c8f1-89b2-4d04-9667-6bc4474cd169 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:36.870775 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419c8f1-89b2-4d04-9667-6bc4474cd169 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:36.870913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:36.871511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419c8f1-89b2-4d04-9667-6bc4474cd169 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:36.871859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419c8f1-89b2-4d04-9667-6bc4474cd169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:36.873330 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419c8f1-89b2-4d04-9667-6bc4474cd169 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:36.874638 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dd28f-c95f-4625-9d4c-15514424ee59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:36.882023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 284/574] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:36.882841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419c8f1-89b2-4d04-9667-6bc4474cd169 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-034dd28f-c95f-4625-9d4c-15514424ee59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:36.882968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:36.883839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 291/575] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:36.889795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dd28f-c95f-4625-9d4c-15514424ee59 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:36.911673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:36.986553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419c8f1-89b2-4d04-9667-6bc4474cd169 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:36.986746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dd28f-c95f-4625-9d4c-15514424ee59 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:37.019793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7188717-c3ef-4425-b685-e031d67b55b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.020363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93221919-34b4-4f36-8bfa-6a48f2b001f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.020483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188717-c3ef-4425-b685-e031d67b55b9 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.020726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188717-c3ef-4425-b685-e031d67b55b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.020996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188717-c3ef-4425-b685-e031d67b55b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.021091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93221919-34b4-4f36-8bfa-6a48f2b001f2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.021290 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93221919-34b4-4f36-8bfa-6a48f2b001f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.021561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93221919-34b4-4f36-8bfa-6a48f2b001f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.021721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7188717-c3ef-4425-b685-e031d67b55b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:37.022024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7188717-c3ef-4425-b685-e031d67b55b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.022453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93221919-34b4-4f36-8bfa-6a48f2b001f2 None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=9a40d290f0e147b9b62cf3eedf399e6c) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:37.022766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93221919-34b4-4f36-8bfa-6a48f2b001f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.023429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7188717-c3ef-4425-b685-e031d67b55b9 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.024179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93221919-34b4-4f36-8bfa-6a48f2b001f2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.029722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 285/576] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:36 2022] GET /identity/v3/role_assignments?user.id=9a40d290f0e147b9b62cf3eedf399e6c&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:37.030525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93221919-34b4-4f36-8bfa-6a48f2b001f2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:37.040812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 292/577] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:37.040812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7188717-c3ef-4425-b685-e031d67b55b9 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:37.111070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:37.137457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:37.155103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93221919-34b4-4f36-8bfa-6a48f2b001f2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:37.159498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7188717-c3ef-4425-b685-e031d67b55b9 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:37.193179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d8719-ef79-4d25-9cef-440ce474ff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.193858 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d8719-ef79-4d25-9cef-440ce474ff18 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.194810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d8719-ef79-4d25-9cef-440ce474ff18 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.194810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d8719-ef79-4d25-9cef-440ce474ff18 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.195176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d8719-ef79-4d25-9cef-440ce474ff18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:37.196364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d8719-ef79-4d25-9cef-440ce474ff18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.196614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bb276-7613-43ba-a519-9199fc924b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.196845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d8719-ef79-4d25-9cef-440ce474ff18 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.198565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bb276-7613-43ba-a519-9199fc924b24 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.198565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bb276-7613-43ba-a519-9199fc924b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.198565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bb276-7613-43ba-a519-9199fc924b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.209261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 286/578] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:37.210158 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d8719-ef79-4d25-9cef-440ce474ff18 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:37.216823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bb276-7613-43ba-a519-9199fc924b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.218518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bb276-7613-43ba-a519-9199fc924b24 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-651bb276-7613-43ba-a519-9199fc924b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:37.239296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:37.240605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:37.241495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:37.241495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:37.241495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:37.241495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:37.241495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 293/579] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:37.241770 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bb276-7613-43ba-a519-9199fc924b24 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:37.330535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d8719-ef79-4d25-9cef-440ce474ff18 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:37.359468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bb276-7613-43ba-a519-9199fc924b24 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:37.366709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adc4f9-6642-48a2-8806-447be1a42229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.367360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adc4f9-6642-48a2-8806-447be1a42229 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.367645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adc4f9-6642-48a2-8806-447be1a42229 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.367934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adc4f9-6642-48a2-8806-447be1a42229 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.368672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adc4f9-6642-48a2-8806-447be1a42229 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:37.368979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adc4f9-6642-48a2-8806-447be1a42229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.370338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adc4f9-6642-48a2-8806-447be1a42229 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.374053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:37.384546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 287/580] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:37.385418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adc4f9-6642-48a2-8806-447be1a42229 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:37.397383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:37.399531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b13ec-7689-46a3-b0fe-3da6749cc29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.400742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b13ec-7689-46a3-b0fe-3da6749cc29e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.401070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b13ec-7689-46a3-b0fe-3da6749cc29e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.401505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b13ec-7689-46a3-b0fe-3da6749cc29e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.410154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b13ec-7689-46a3-b0fe-3da6749cc29e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.411659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b13ec-7689-46a3-b0fe-3da6749cc29e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-3c9b13ec-7689-46a3-b0fe-3da6749cc29e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:37.426326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:37.427293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 294/581] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:37.433472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b13ec-7689-46a3-b0fe-3da6749cc29e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:37.500920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adc4f9-6642-48a2-8806-447be1a42229 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:37.536551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ce45-d716-459c-9e78-b4de91151d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.537673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ce45-d716-459c-9e78-b4de91151d8f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.538098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ce45-d716-459c-9e78-b4de91151d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.538402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ce45-d716-459c-9e78-b4de91151d8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.539991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b13ec-7689-46a3-b0fe-3da6749cc29e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:37.545509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26ce45-d716-459c-9e78-b4de91151d8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.547000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26ce45-d716-459c-9e78-b4de91151d8f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-9c26ce45-d716-459c-9e78-b4de91151d8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:37.561379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:37.562327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:37.563259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:37.563259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:37.563259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:37.563259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:37.563259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:37.563259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:37.563259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:37.563259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:37.563259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 288/582] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:37.568318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ce45-d716-459c-9e78-b4de91151d8f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:37.582330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db31a6-c85b-4ed5-884b-e4934b465dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.583225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db31a6-c85b-4ed5-884b-e4934b465dbb None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.583640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db31a6-c85b-4ed5-884b-e4934b465dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.584084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db31a6-c85b-4ed5-884b-e4934b465dbb None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.584817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db31a6-c85b-4ed5-884b-e4934b465dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:37.585120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db31a6-c85b-4ed5-884b-e4934b465dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.586506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db31a6-c85b-4ed5-884b-e4934b465dbb None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.603265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 295/583] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:37.604775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db31a6-c85b-4ed5-884b-e4934b465dbb None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:37.636296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:37.650671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:37.687642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ce45-d716-459c-9e78-b4de91151d8f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:37.715538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db31a6-c85b-4ed5-884b-e4934b465dbb None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:37.724678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba2e86-9476-441d-815c-d2ed7df317b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.725493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba2e86-9476-441d-815c-d2ed7df317b2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.726057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba2e86-9476-441d-815c-d2ed7df317b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.726057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba2e86-9476-441d-815c-d2ed7df317b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.736541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba2e86-9476-441d-815c-d2ed7df317b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.738000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba2e86-9476-441d-815c-d2ed7df317b2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.751887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452c5b7-b44e-4373-a11b-ad06fa54c6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.753636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452c5b7-b44e-4373-a11b-ad06fa54c6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.753925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452c5b7-b44e-4373-a11b-ad06fa54c6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.754214 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452c5b7-b44e-4373-a11b-ad06fa54c6a2 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.755091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452c5b7-b44e-4373-a11b-ad06fa54c6a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:37.755370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452c5b7-b44e-4373-a11b-ad06fa54c6a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-f1ba2e86-9476-441d-815c-d2ed7df317b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:37.756198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:37.757045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:37.757949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:37.757949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:37.757949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:37.757949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:37.758191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452c5b7-b44e-4373-a11b-ad06fa54c6a2 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.758264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 289/584] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:37.758775 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba2e86-9476-441d-815c-d2ed7df317b2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:37.779935 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 296/585] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:37.780598 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452c5b7-b44e-4373-a11b-ad06fa54c6a2 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:37.867300 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba2e86-9476-441d-815c-d2ed7df317b2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:37.873912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:37.885697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452c5b7-b44e-4373-a11b-ad06fa54c6a2 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:37.890450 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:37.905703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195436a6-d7b3-4100-8fed-6efd798340b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.906516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195436a6-d7b3-4100-8fed-6efd798340b1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.906792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195436a6-d7b3-4100-8fed-6efd798340b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.907105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195436a6-d7b3-4100-8fed-6efd798340b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.908557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195436a6-d7b3-4100-8fed-6efd798340b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:37.908975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195436a6-d7b3-4100-8fed-6efd798340b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.910533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195436a6-d7b3-4100-8fed-6efd798340b1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.919856 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce537fc-0153-401d-a1e2-6d27966e6563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:37.920668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce537fc-0153-401d-a1e2-6d27966e6563 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:37.920948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce537fc-0153-401d-a1e2-6d27966e6563 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:37.921218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce537fc-0153-401d-a1e2-6d27966e6563 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:37.927721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 290/586] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:37.927721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195436a6-d7b3-4100-8fed-6efd798340b1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:37.934439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce537fc-0153-401d-a1e2-6d27966e6563 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:37.936032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce537fc-0153-401d-a1e2-6d27966e6563 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-4ce537fc-0153-401d-a1e2-6d27966e6563 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:37.951011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:37.951948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:37.952875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:37.952875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:37.952875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:37.952875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:37.952875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:37.952875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:37.952875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:37.952875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:37.952875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 03:04:37.952875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:37.952875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 297/587] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:37.953455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce537fc-0153-401d-a1e2-6d27966e6563 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:38.037626 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195436a6-d7b3-4100-8fed-6efd798340b1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:38.072647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce537fc-0153-401d-a1e2-6d27966e6563 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:38.077267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe3777-60f2-480c-8961-3a15b862c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:38.077941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe3777-60f2-480c-8961-3a15b862c16b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:38.078217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe3777-60f2-480c-8961-3a15b862c16b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:38.078512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe3777-60f2-480c-8961-3a15b862c16b None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:38.080076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe3777-60f2-480c-8961-3a15b862c16b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:38.080375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe3777-60f2-480c-8961-3a15b862c16b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:38.081748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe3777-60f2-480c-8961-3a15b862c16b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:38.099182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 291/588] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:38.100066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe3777-60f2-480c-8961-3a15b862c16b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:38.108870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4103a9-c41d-494a-8b2a-8a047124ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:38.109694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4103a9-c41d-494a-8b2a-8a047124ae37 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:38.109969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4103a9-c41d-494a-8b2a-8a047124ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:38.110364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4103a9-c41d-494a-8b2a-8a047124ae37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:38.121659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4103a9-c41d-494a-8b2a-8a047124ae37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:38.123190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4103a9-c41d-494a-8b2a-8a047124ae37 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-3f4103a9-c41d-494a-8b2a-8a047124ae37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:38.142896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:38.143855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:38.144818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:38.144818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:38.144818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:38.144818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:38.144818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 298/589] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:38.145094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4103a9-c41d-494a-8b2a-8a047124ae37 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:38.151433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:38.152071 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:38.217304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe3777-60f2-480c-8961-3a15b862c16b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:38.253256 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abd0b6-1739-4169-b1ed-7b7531923575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:38.254151 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd0b6-1739-4169-b1ed-7b7531923575 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:38.254456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd0b6-1739-4169-b1ed-7b7531923575 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:38.254740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd0b6-1739-4169-b1ed-7b7531923575 None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/70604923ae0b4a4dae21de1314cddbf6/roles/a26fe2ec418e475fb65528485c92428a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:38.255416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4103a9-c41d-494a-8b2a-8a047124ae37 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:38.273806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abd0b6-1739-4169-b1ed-7b7531923575 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=70604923ae0b4a4dae21de1314cddbf6, role_id=a26fe2ec418e475fb65528485c92428a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:38.275321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abd0b6-1739-4169-b1ed-7b7531923575 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:38.289350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 292/590] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:04:38 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/70604923ae0b4a4dae21de1314cddbf6/roles/a26fe2ec418e475fb65528485c92428a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:38.294638 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abd0b6-1739-4169-b1ed-7b7531923575 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:38.296198 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bef92e-e5f2-4ff8-af26-cf065d911707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:38.296910 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bef92e-e5f2-4ff8-af26-cf065d911707 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:38.297194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bef92e-e5f2-4ff8-af26-cf065d911707 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:38.297490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bef92e-e5f2-4ff8-af26-cf065d911707 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:38.298480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bef92e-e5f2-4ff8-af26-cf065d911707 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:38.298783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bef92e-e5f2-4ff8-af26-cf065d911707 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:38.300258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bef92e-e5f2-4ff8-af26-cf065d911707 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:38.321879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 299/591] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Jun 28 03:04:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:38.324544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bef92e-e5f2-4ff8-af26-cf065d911707 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:38.405319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:38.419402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:38.425166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abd0b6-1739-4169-b1ed-7b7531923575 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:38.467639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bef92e-e5f2-4ff8-af26-cf065d911707 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:38.469432 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012818e-fedb-4e43-ad1b-d3da6e78f867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:38.470460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012818e-fedb-4e43-ad1b-d3da6e78f867 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:38.470800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012818e-fedb-4e43-ad1b-d3da6e78f867 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:38.471140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012818e-fedb-4e43-ad1b-d3da6e78f867 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:38.479349 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012818e-fedb-4e43-ad1b-d3da6e78f867 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:38.480921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012818e-fedb-4e43-ad1b-d3da6e78f867 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-6012818e-fedb-4e43-ad1b-d3da6e78f867 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:38.496716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:38.497737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:38.499240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:38.499240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:38.499240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:38.499240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:38.499240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:38.499240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:38.499240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:38.499240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:38.499240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 03:04:38.499240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:38.499240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 293/592] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:38.500329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012818e-fedb-4e43-ad1b-d3da6e78f867 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:38.510773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0d9ab-181d-4704-afa2-e21ac8d9a2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:38.511455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d9ab-181d-4704-afa2-e21ac8d9a2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:38.511733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d9ab-181d-4704-afa2-e21ac8d9a2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:38.512048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d9ab-181d-4704-afa2-e21ac8d9a2d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:38.512778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0d9ab-181d-4704-afa2-e21ac8d9a2d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:38.513081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0d9ab-181d-4704-afa2-e21ac8d9a2d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:38.514542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0d9ab-181d-4704-afa2-e21ac8d9a2d7 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:38.528331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 300/593] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:38.529251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0d9ab-181d-4704-afa2-e21ac8d9a2d7 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:38.628967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012818e-fedb-4e43-ad1b-d3da6e78f867 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:38.669637 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0d9ab-181d-4704-afa2-e21ac8d9a2d7 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:38.677856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252aa243-55b3-406e-bf29-fa44e34f50ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:38.678712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aa243-55b3-406e-bf29-fa44e34f50ea None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:38.678987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aa243-55b3-406e-bf29-fa44e34f50ea None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:38.679255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aa243-55b3-406e-bf29-fa44e34f50ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:38.692098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252aa243-55b3-406e-bf29-fa44e34f50ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:38.693740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252aa243-55b3-406e-bf29-fa44e34f50ea None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:38.705247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-252aa243-55b3-406e-bf29-fa44e34f50ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:38.715587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:38.717473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:38.719514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:38.719514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:38.719514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:38.719514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:38.722188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 294/594] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:38.723168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252aa243-55b3-406e-bf29-fa44e34f50ea None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:38.729275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:38.740912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b8ddd-4eb5-4a48-8ddd-fa7bf4e6eb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:38.742472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b8ddd-4eb5-4a48-8ddd-fa7bf4e6eb35 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:38.743220 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b8ddd-4eb5-4a48-8ddd-fa7bf4e6eb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:38.743986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b8ddd-4eb5-4a48-8ddd-fa7bf4e6eb35 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:38.745831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b8ddd-4eb5-4a48-8ddd-fa7bf4e6eb35 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:38.746656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b8ddd-4eb5-4a48-8ddd-fa7bf4e6eb35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:38.749604 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b8ddd-4eb5-4a48-8ddd-fa7bf4e6eb35 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:38.782223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 301/595] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Jun 28 03:04:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:38.784393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b8ddd-4eb5-4a48-8ddd-fa7bf4e6eb35 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:38.847214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252aa243-55b3-406e-bf29-fa44e34f50ea None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:38.884463 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed9f3d-6645-45de-8194-7ea2ff071f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:38.885235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed9f3d-6645-45de-8194-7ea2ff071f9d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:38.885511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed9f3d-6645-45de-8194-7ea2ff071f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:38.885821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed9f3d-6645-45de-8194-7ea2ff071f9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:38.890237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b8ddd-4eb5-4a48-8ddd-fa7bf4e6eb35 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:38.894236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed9f3d-6645-45de-8194-7ea2ff071f9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:38.895727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed9f3d-6645-45de-8194-7ea2ff071f9d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a4ed9f3d-6645-45de-8194-7ea2ff071f9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:38.913583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:38.915378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:38.916742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:38.916742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:38.916742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:38.916742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:38.916742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:38.916742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:38.916742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:38.916742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:38.918646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 295/596] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:38.919944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed9f3d-6645-45de-8194-7ea2ff071f9d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:38.934947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47141af-6a4c-4af9-b7c3-f64795d49fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:38.935998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47141af-6a4c-4af9-b7c3-f64795d49fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:38.936514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47141af-6a4c-4af9-b7c3-f64795d49fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:38.936976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47141af-6a4c-4af9-b7c3-f64795d49fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:38.937919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47141af-6a4c-4af9-b7c3-f64795d49fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:38.938496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47141af-6a4c-4af9-b7c3-f64795d49fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:38.940079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47141af-6a4c-4af9-b7c3-f64795d49fa4 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:38.955311 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 302/597] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:38.956727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47141af-6a4c-4af9-b7c3-f64795d49fa4 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:38.996784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:39.002106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:39.043729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed9f3d-6645-45de-8194-7ea2ff071f9d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:39.065968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47141af-6a4c-4af9-b7c3-f64795d49fa4 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:39.087043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c25e19-7a29-421f-9d26-19de72bfa37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:39.088124 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c25e19-7a29-421f-9d26-19de72bfa37d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.088551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c25e19-7a29-421f-9d26-19de72bfa37d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.088965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c25e19-7a29-421f-9d26-19de72bfa37d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:39.101642 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1215c-4a1c-40ec-adab-3ab06786c27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:39.102173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c25e19-7a29-421f-9d26-19de72bfa37d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:39.102568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1215c-4a1c-40ec-adab-3ab06786c27c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.102944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1215c-4a1c-40ec-adab-3ab06786c27c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.103308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1215c-4a1c-40ec-adab-3ab06786c27c None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:39.104200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1215c-4a1c-40ec-adab-3ab06786c27c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:39.104575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c25e19-7a29-421f-9d26-19de72bfa37d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:39.104699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1215c-4a1c-40ec-adab-3ab06786c27c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:39.106303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1215c-4a1c-40ec-adab-3ab06786c27c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:39.123993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 303/598] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:39.123993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1215c-4a1c-40ec-adab-3ab06786c27c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-43c25e19-7a29-421f-9d26-19de72bfa37d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:39.129042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:39.129955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:39.130886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:39.130886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:39.130886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:39.130886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:39.136339 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 296/599] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:39.136339 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c25e19-7a29-421f-9d26-19de72bfa37d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:39.224560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:39.229333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1215c-4a1c-40ec-adab-3ab06786c27c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:39.240439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c25e19-7a29-421f-9d26-19de72bfa37d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:39.255275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:39.269796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00562280-8982-447a-8ae8-0f0dc41d9dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:39.270664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00562280-8982-447a-8ae8-0f0dc41d9dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.270949 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00562280-8982-447a-8ae8-0f0dc41d9dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.271216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00562280-8982-447a-8ae8-0f0dc41d9dc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:39.276131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78359eb7-c9ec-48c2-b61a-c916161501db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:39.277025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359eb7-c9ec-48c2-b61a-c916161501db None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.277294 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359eb7-c9ec-48c2-b61a-c916161501db None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.277561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78359eb7-c9ec-48c2-b61a-c916161501db None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/b1868e9d8b004c4fb781e532c775428e/roles/a26fe2ec418e475fb65528485c92428a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:39.277915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00562280-8982-447a-8ae8-0f0dc41d9dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:39.279379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00562280-8982-447a-8ae8-0f0dc41d9dc3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:39.293323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78359eb7-c9ec-48c2-b61a-c916161501db None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=b1868e9d8b004c4fb781e532c775428e, role_id=a26fe2ec418e475fb65528485c92428a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:39.294806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78359eb7-c9ec-48c2-b61a-c916161501db None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-00562280-8982-447a-8ae8-0f0dc41d9dc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:39.297956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:39.299009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:39.299954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:39.299954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:39.299954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:39.299954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:39.299954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:39.299954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:39.299954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:39.299954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:39.299954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 304/600] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:39.300514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef038e24-e19c-42a2-af1f-80f35c7a5684 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.300635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef038e24-e19c-42a2-af1f-80f35c7a5684 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.300908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef038e24-e19c-42a2-af1f-80f35c7a5684 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:39.302365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 305/601] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:39.307105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef038e24-e19c-42a2-af1f-80f35c7a5684 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:39.315369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 297/602] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:04:39 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/b1868e9d8b004c4fb781e532c775428e/roles/a26fe2ec418e475fb65528485c92428a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:39.316406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78359eb7-c9ec-48c2-b61a-c916161501db None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:39.424010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef038e24-e19c-42a2-af1f-80f35c7a5684 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:39.459417 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78359eb7-c9ec-48c2-b61a-c916161501db None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:39.462177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbbd34-f4f8-4c07-b23f-304e86e3dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:39.462901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbbd34-f4f8-4c07-b23f-304e86e3dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.463181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbbd34-f4f8-4c07-b23f-304e86e3dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.463453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbbd34-f4f8-4c07-b23f-304e86e3dbb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:39.464200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbbd34-f4f8-4c07-b23f-304e86e3dbb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:39.464505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbbd34-f4f8-4c07-b23f-304e86e3dbb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:39.465978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbbd34-f4f8-4c07-b23f-304e86e3dbb3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:39.481188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 306/603] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:39.482748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08452a4-bd08-4fae-b587-7bd6dfd63ef2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.483026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08452a4-bd08-4fae-b587-7bd6dfd63ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.483300 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08452a4-bd08-4fae-b587-7bd6dfd63ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:39.504288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e08452a4-bd08-4fae-b587-7bd6dfd63ef2 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:39.505506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e08452a4-bd08-4fae-b587-7bd6dfd63ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:39.514578 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea188e-0d28-4ab5-ab3b-f76f1be8ff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:39.515285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea188e-0d28-4ab5-ab3b-f76f1be8ff27 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.515563 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea188e-0d28-4ab5-ab3b-f76f1be8ff27 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.515840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea188e-0d28-4ab5-ab3b-f76f1be8ff27 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:39.516798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea188e-0d28-4ab5-ab3b-f76f1be8ff27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:39.517107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea188e-0d28-4ab5-ab3b-f76f1be8ff27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:39.518757 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea188e-0d28-4ab5-ab3b-f76f1be8ff27 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:39.522583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:39.532411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 298/604] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:39.533679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea188e-0d28-4ab5-ab3b-f76f1be8ff27 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:39.562668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:39.592633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 307/605] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:39.593796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08452a4-bd08-4fae-b587-7bd6dfd63ef2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:39.661026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea188e-0d28-4ab5-ab3b-f76f1be8ff27 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:39.696273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9f770-4015-49f7-809c-12de203db9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:39.697070 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9f770-4015-49f7-809c-12de203db9bd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.697355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9f770-4015-49f7-809c-12de203db9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.697626 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9f770-4015-49f7-809c-12de203db9bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:39.704999 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9f770-4015-49f7-809c-12de203db9bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:39.705426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08452a4-bd08-4fae-b587-7bd6dfd63ef2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:39.706516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9f770-4015-49f7-809c-12de203db9bd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-61f9f770-4015-49f7-809c-12de203db9bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:39.721538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:39.722502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:39.723372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:39.723372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:39.723372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:39.723372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:39.723372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:39.723372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:39.723372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:39.723372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:39.723372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 299/606] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:39.724343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9f770-4015-49f7-809c-12de203db9bd None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:39.748498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851c928-fea3-4fd3-866a-9884e2b06f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:39.749411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851c928-fea3-4fd3-866a-9884e2b06f35 None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.749689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851c928-fea3-4fd3-866a-9884e2b06f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.749963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851c928-fea3-4fd3-866a-9884e2b06f35 None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/d7e0632bc12346b38663a0ef97ab1a99/roles/a26fe2ec418e475fb65528485c92428a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:39.765474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851c928-fea3-4fd3-866a-9884e2b06f35 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=d7e0632bc12346b38663a0ef97ab1a99, role_id=a26fe2ec418e475fb65528485c92428a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:39.767616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851c928-fea3-4fd3-866a-9884e2b06f35 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:39.780942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:39.794375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 308/607] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:04:39 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/d7e0632bc12346b38663a0ef97ab1a99/roles/a26fe2ec418e475fb65528485c92428a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:39.795412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851c928-fea3-4fd3-866a-9884e2b06f35 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:39.845042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:39.876915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9f770-4015-49f7-809c-12de203db9bd None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:39.943385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb9101-c5f0-46ce-8166-ad9a2df89e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:39.944317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb9101-c5f0-46ce-8166-ad9a2df89e62 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.944599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb9101-c5f0-46ce-8166-ad9a2df89e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.944866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb9101-c5f0-46ce-8166-ad9a2df89e62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:39.953257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851c928-fea3-4fd3-866a-9884e2b06f35 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:39.978369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb9101-c5f0-46ce-8166-ad9a2df89e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d7fb9101-c5f0-46ce-8166-ad9a2df89e62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:39.986808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:39.987756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:39.988670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:39.991867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 300/608] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:39.997903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb9101-c5f0-46ce-8166-ad9a2df89e62 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:39.998065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bb08f-54cc-4e04-8f99-b9077ec3fd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:39.998681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bb08f-54cc-4e04-8f99-b9077ec3fd1c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:39.998965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bb08f-54cc-4e04-8f99-b9077ec3fd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:39.999237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bb08f-54cc-4e04-8f99-b9077ec3fd1c None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:40.000038 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bb08f-54cc-4e04-8f99-b9077ec3fd1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:40.000345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bb08f-54cc-4e04-8f99-b9077ec3fd1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:40.003689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bb08f-54cc-4e04-8f99-b9077ec3fd1c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:40.017881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 309/609] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:40.023808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bb08f-54cc-4e04-8f99-b9077ec3fd1c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:40.099909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:40.133477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb9101-c5f0-46ce-8166-ad9a2df89e62 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:40.176880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bb08f-54cc-4e04-8f99-b9077ec3fd1c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:40.194506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383f770-bf7b-4575-b260-c40e6b839e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:40.195235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f770-bf7b-4575-b260-c40e6b839e2f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:40.195512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f770-bf7b-4575-b260-c40e6b839e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:40.195777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f770-bf7b-4575-b260-c40e6b839e2f None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:40.196531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383f770-bf7b-4575-b260-c40e6b839e2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:40.197288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383f770-bf7b-4575-b260-c40e6b839e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:40.199107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383f770-bf7b-4575-b260-c40e6b839e2f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:40.212419 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 301/610] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:40.220375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383f770-bf7b-4575-b260-c40e6b839e2f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:40.234618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:40.247928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135601c-890a-4a10-9e5e-dcbfb1875187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:40.248838 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135601c-890a-4a10-9e5e-dcbfb1875187 None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:40.249114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135601c-890a-4a10-9e5e-dcbfb1875187 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:40.249378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135601c-890a-4a10-9e5e-dcbfb1875187 None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/0f8a5bc11b6745a196337b4dc48de14e/roles/a26fe2ec418e475fb65528485c92428a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:40.275440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135601c-890a-4a10-9e5e-dcbfb1875187 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=0f8a5bc11b6745a196337b4dc48de14e, role_id=a26fe2ec418e475fb65528485c92428a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:40.276892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135601c-890a-4a10-9e5e-dcbfb1875187 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:40.301957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 310/611] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:04:40 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/0f8a5bc11b6745a196337b4dc48de14e/roles/a26fe2ec418e475fb65528485c92428a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:40.394698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383f770-bf7b-4575-b260-c40e6b839e2f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:40.448512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6c8fb-976b-40b8-935a-38ba3ee23539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:40.449346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c8fb-976b-40b8-935a-38ba3ee23539 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:40.449623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c8fb-976b-40b8-935a-38ba3ee23539 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:40.449892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c8fb-976b-40b8-935a-38ba3ee23539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:40.471817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6c8fb-976b-40b8-935a-38ba3ee23539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:40.473223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6c8fb-976b-40b8-935a-38ba3ee23539 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-cbd6c8fb-976b-40b8-935a-38ba3ee23539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:40.496729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:40.497684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:40.498608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:40.498608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:40.498608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:40.498608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:40.498608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 302/612] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:40.504189 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135601c-890a-4a10-9e5e-dcbfb1875187 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:40.541626 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781f1c2-4a70-4ea4-acaa-efe8614caa66 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:40.541907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781f1c2-4a70-4ea4-acaa-efe8614caa66 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:40.542190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781f1c2-4a70-4ea4-acaa-efe8614caa66 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:40.543988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 303/613] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:04:40.550081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bb989-9864-4f71-a3b1-3c20a7ed809a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:40.550409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bb989-9864-4f71-a3b1-3c20a7ed809a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:40.550690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bb989-9864-4f71-a3b1-3c20a7ed809a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:40.575617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-219bb989-9864-4f71-a3b1-3c20a7ed809a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:40.577137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-219bb989-9864-4f71-a3b1-3c20a7ed809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:40.678193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:40.685427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135601c-890a-4a10-9e5e-dcbfb1875187 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:40.702840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:40.716948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 304/614] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:40.727928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740a808-9755-4331-b8ad-e32a6b09bee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:40.729300 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a808-9755-4331-b8ad-e32a6b09bee4 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:40.730053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a808-9755-4331-b8ad-e32a6b09bee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:40.730778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a808-9755-4331-b8ad-e32a6b09bee4 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:40.732067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740a808-9755-4331-b8ad-e32a6b09bee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:40.732571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740a808-9755-4331-b8ad-e32a6b09bee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:40.734214 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740a808-9755-4331-b8ad-e32a6b09bee4 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:40.747530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 311/615] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:40.753713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bb989-9864-4f71-a3b1-3c20a7ed809a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:40.759956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740a808-9755-4331-b8ad-e32a6b09bee4 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:40.875008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740a808-9755-4331-b8ad-e32a6b09bee4 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:40.911098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d6388-4f9d-40f5-9792-1150cc21818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:40.912299 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d6388-4f9d-40f5-9792-1150cc21818d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:40.912781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d6388-4f9d-40f5-9792-1150cc21818d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:40.913251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d6388-4f9d-40f5-9792-1150cc21818d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:40.924467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d6388-4f9d-40f5-9792-1150cc21818d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-8b9d6388-4f9d-40f5-9792-1150cc21818d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:40.932731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:40.933696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:40.934633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:40.937356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 312/616] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:40.943326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d6388-4f9d-40f5-9792-1150cc21818d None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:40.968243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bb989-9864-4f71-a3b1-3c20a7ed809a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:40.979294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:41.049385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d6388-4f9d-40f5-9792-1150cc21818d None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:41.052585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f47f5b-0986-424f-8433-a3a87150eca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:41.053764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f47f5b-0986-424f-8433-a3a87150eca2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:41.053764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f47f5b-0986-424f-8433-a3a87150eca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:41.053945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f47f5b-0986-424f-8433-a3a87150eca2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:41.071574 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f47f5b-0986-424f-8433-a3a87150eca2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:41.073106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f47f5b-0986-424f-8433-a3a87150eca2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:41.092774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b17319-5435-4506-9f1a-114bc5de4e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:41.093780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b17319-5435-4506-9f1a-114bc5de4e73 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:41.094265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b17319-5435-4506-9f1a-114bc5de4e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:41.094961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b17319-5435-4506-9f1a-114bc5de4e73 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-48f47f5b-0986-424f-8433-a3a87150eca2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:41.095678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:41.096611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:41.097551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:41.097551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:41.097551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:41.097551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:41.097551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:41.097551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:41.097551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:41.097551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:41.097551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:04:41.097551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:41.098986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b17319-5435-4506-9f1a-114bc5de4e73 None admin] RBAC: Adding query filter params (name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:41.099506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b17319-5435-4506-9f1a-114bc5de4e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:41.101180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b17319-5435-4506-9f1a-114bc5de4e73 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:41.107064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 305/617] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:41.113886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f47f5b-0986-424f-8433-a3a87150eca2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:41.123669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 313/618] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:41.128581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b17319-5435-4506-9f1a-114bc5de4e73 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:41.212582 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:41.278446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f47f5b-0986-424f-8433-a3a87150eca2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:41.294724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:41.313003 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b17319-5435-4506-9f1a-114bc5de4e73 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:41.314878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d769d-ba15-434d-9fd4-360dc9c197f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:41.315787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d769d-ba15-434d-9fd4-360dc9c197f5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:41.316245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d769d-ba15-434d-9fd4-360dc9c197f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:41.316684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d769d-ba15-434d-9fd4-360dc9c197f5 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:41.317756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d769d-ba15-434d-9fd4-360dc9c197f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:41.318232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d769d-ba15-434d-9fd4-360dc9c197f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:41.320892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d769d-ba15-434d-9fd4-360dc9c197f5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:41.342231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 306/619] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Jun 28 03:04:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:41.351548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d769d-ba15-434d-9fd4-360dc9c197f5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:41.387945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e5eb1-a5aa-4260-b403-e72bf225e2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:41.388764 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e5eb1-a5aa-4260-b403-e72bf225e2da None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:41.389045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e5eb1-a5aa-4260-b403-e72bf225e2da None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:41.389314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e5eb1-a5aa-4260-b403-e72bf225e2da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:41.412414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e5eb1-a5aa-4260-b403-e72bf225e2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:41.413869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e5eb1-a5aa-4260-b403-e72bf225e2da None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-345e5eb1-a5aa-4260-b403-e72bf225e2da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:41.454390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:41.455552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:41.457069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:41.457069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:41.457069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:41.457069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:41.457069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 314/620] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:41.461782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e5eb1-a5aa-4260-b403-e72bf225e2da None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:41.463220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d769d-ba15-434d-9fd4-360dc9c197f5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:41.472522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:41.525078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b07136-28b0-4483-81b0-23cab5d59820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:41.525882 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b07136-28b0-4483-81b0-23cab5d59820 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:41.526156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b07136-28b0-4483-81b0-23cab5d59820 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:41.526446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b07136-28b0-4483-81b0-23cab5d59820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:41.546062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b07136-28b0-4483-81b0-23cab5d59820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:41.547489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b07136-28b0-4483-81b0-23cab5d59820 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-62b07136-28b0-4483-81b0-23cab5d59820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:41.581498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:41.582504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:41.583867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:41.583867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:41.583867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:41.583867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:41.583867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 307/621] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:41.590634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b07136-28b0-4483-81b0-23cab5d59820 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:41.643442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e5eb1-a5aa-4260-b403-e72bf225e2da None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:41.706064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8424ba-7a39-4946-93c0-67c616cd58b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:41.706778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8424ba-7a39-4946-93c0-67c616cd58b0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:41.707343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8424ba-7a39-4946-93c0-67c616cd58b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:41.707619 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8424ba-7a39-4946-93c0-67c616cd58b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:41.708351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8424ba-7a39-4946-93c0-67c616cd58b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:41.708652 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8424ba-7a39-4946-93c0-67c616cd58b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:41.710030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8424ba-7a39-4946-93c0-67c616cd58b0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:41.730480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 315/622] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:41.734792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8424ba-7a39-4946-93c0-67c616cd58b0 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:41.742625 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:41.828336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b07136-28b0-4483-81b0-23cab5d59820 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:41.839428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8424ba-7a39-4946-93c0-67c616cd58b0 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:41.868375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a184b92-2924-46ec-907a-95aef69eb1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:41.869054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a184b92-2924-46ec-907a-95aef69eb1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:41.869340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a184b92-2924-46ec-907a-95aef69eb1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:41.869607 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a184b92-2924-46ec-907a-95aef69eb1b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:41.870352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a184b92-2924-46ec-907a-95aef69eb1b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:41.870687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a184b92-2924-46ec-907a-95aef69eb1b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:41.872286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a184b92-2924-46ec-907a-95aef69eb1b8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:41.876895 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45e002-97d4-4318-bc5b-ca5b919f64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:41.878048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e002-97d4-4318-bc5b-ca5b919f64b1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:41.878592 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e002-97d4-4318-bc5b-ca5b919f64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:41.879109 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e002-97d4-4318-bc5b-ca5b919f64b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:41.889134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 308/623] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:41.889134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6987be-3d63-42fb-885e-3a8fae58e66a None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:41.889134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6987be-3d63-42fb-885e-3a8fae58e66a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:41.889134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6987be-3d63-42fb-885e-3a8fae58e66a None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:41.892254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 309/624] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:41.892561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e002-97d4-4318-bc5b-ca5b919f64b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:41.893625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144faba-e27e-45e5-a524-1384bdf3e81b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:41.893900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144faba-e27e-45e5-a524-1384bdf3e81b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:41.894176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144faba-e27e-45e5-a524-1384bdf3e81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:41.895002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e002-97d4-4318-bc5b-ca5b919f64b1 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-4b45e002-97d4-4318-bc5b-ca5b919f64b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:41.910888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:41.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:41.912869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:41.912869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:41.912869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:41.912869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:41.912869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:41.912869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:41.912869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:41.912869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:41.912869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 28 03:04:41.912869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:41.913421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3144faba-e27e-45e5-a524-1384bdf3e81b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:41.913421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3144faba-e27e-45e5-a524-1384bdf3e81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:41.915735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 316/625] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:41.916728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45e002-97d4-4318-bc5b-ca5b919f64b1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:41.955033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:41.987007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:41.999424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 310/626] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 03:04:42.000585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144faba-e27e-45e5-a524-1384bdf3e81b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:42.035875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45e002-97d4-4318-bc5b-ca5b919f64b1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:42.075270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909e0a3-1ca2-43f1-b2ea-01da0e10cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:42.076489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909e0a3-1ca2-43f1-b2ea-01da0e10cfee None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.076985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909e0a3-1ca2-43f1-b2ea-01da0e10cfee None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.077452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909e0a3-1ca2-43f1-b2ea-01da0e10cfee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.085577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909e0a3-1ca2-43f1-b2ea-01da0e10cfee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:42.087472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909e0a3-1ca2-43f1-b2ea-01da0e10cfee None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-a909e0a3-1ca2-43f1-b2ea-01da0e10cfee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:42.103403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:42.104378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:42.105269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:42.105269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:42.105269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:42.105269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:42.105269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:42.105269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:42.105269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:42.105269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:42.112527 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 317/627] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:42.113777 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909e0a3-1ca2-43f1-b2ea-01da0e10cfee None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:42.138832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144faba-e27e-45e5-a524-1384bdf3e81b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:42.172933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53385fd2-078b-4adb-9f69-18ce5bad4d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:42.173694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385fd2-078b-4adb-9f69-18ce5bad4d60 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.173971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385fd2-078b-4adb-9f69-18ce5bad4d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.174236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385fd2-078b-4adb-9f69-18ce5bad4d60 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.175170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53385fd2-078b-4adb-9f69-18ce5bad4d60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:42.175413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53385fd2-078b-4adb-9f69-18ce5bad4d60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:42.176837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53385fd2-078b-4adb-9f69-18ce5bad4d60 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:42.199253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 311/628] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Jun 28 03:04:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:42.200195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53385fd2-078b-4adb-9f69-18ce5bad4d60 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:42.209064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:42.235358 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909e0a3-1ca2-43f1-b2ea-01da0e10cfee None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:42.263653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:42.276265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f4f49-821c-43aa-871f-18d9dfd70324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:42.277564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4f49-821c-43aa-871f-18d9dfd70324 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.277993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4f49-821c-43aa-871f-18d9dfd70324 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.278318 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4f49-821c-43aa-871f-18d9dfd70324 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.289376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f4f49-821c-43aa-871f-18d9dfd70324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-c50f4f49-821c-43aa-871f-18d9dfd70324 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:42.299946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:42.300870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 318/629] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:42.306690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f4f49-821c-43aa-871f-18d9dfd70324 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:42.311529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53385fd2-078b-4adb-9f69-18ce5bad4d60 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:42.351421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0faba-1afb-4ec0-bbf8-4fac991b9c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:42.352092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0faba-1afb-4ec0-bbf8-4fac991b9c5d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.352433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0faba-1afb-4ec0-bbf8-4fac991b9c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.352767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0faba-1afb-4ec0-bbf8-4fac991b9c5d None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.353626 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0faba-1afb-4ec0-bbf8-4fac991b9c5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:42.353988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0faba-1afb-4ec0-bbf8-4fac991b9c5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:42.356017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0faba-1afb-4ec0-bbf8-4fac991b9c5d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:42.370396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 312/630] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:42.371517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f34c38-0e1a-4d5d-91d3-f036863edddb None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.371799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f34c38-0e1a-4d5d-91d3-f036863edddb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.372068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f34c38-0e1a-4d5d-91d3-f036863edddb None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.378055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 313/631] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:42.378055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f34c38-0e1a-4d5d-91d3-f036863edddb None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:42.421778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f4f49-821c-43aa-871f-18d9dfd70324 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:42.456202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6ed04-6bd4-41f2-a31c-1c1ed8dd0108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:42.456872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ed04-6bd4-41f2-a31c-1c1ed8dd0108 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.457154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ed04-6bd4-41f2-a31c-1c1ed8dd0108 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.457429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ed04-6bd4-41f2-a31c-1c1ed8dd0108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.459129 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:42.499886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f34c38-0e1a-4d5d-91d3-f036863edddb None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:42.515725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:42.535378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dd623-5981-4408-90e1-14f57da5f644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:42.536047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dd623-5981-4408-90e1-14f57da5f644 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.536168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6ed04-6bd4-41f2-a31c-1c1ed8dd0108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:42.536348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dd623-5981-4408-90e1-14f57da5f644 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.536603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dd623-5981-4408-90e1-14f57da5f644 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.537352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dd623-5981-4408-90e1-14f57da5f644 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:42.537521 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6ed04-6bd4-41f2-a31c-1c1ed8dd0108 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:42.537670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dd623-5981-4408-90e1-14f57da5f644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:42.539117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dd623-5981-4408-90e1-14f57da5f644 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:42.548302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 314/632] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:42.551154 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dd623-5981-4408-90e1-14f57da5f644 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:42.647914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 319/633] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:42.649376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c5bbf-3f4f-4fd7-a062-f82277ee65d5 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.649672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c5bbf-3f4f-4fd7-a062-f82277ee65d5 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.649941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c5bbf-3f4f-4fd7-a062-f82277ee65d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.658754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dd623-5981-4408-90e1-14f57da5f644 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:42.666556 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-852c5bbf-3f4f-4fd7-a062-f82277ee65d5 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:42.667774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-852c5bbf-3f4f-4fd7-a062-f82277ee65d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:42.684276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:42.692585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90790d-c085-4f17-b2d1-e4ac4cf8e0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:42.693493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90790d-c085-4f17-b2d1-e4ac4cf8e0b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.693774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90790d-c085-4f17-b2d1-e4ac4cf8e0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.694047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90790d-c085-4f17-b2d1-e4ac4cf8e0b0 None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/9a40d290f0e147b9b62cf3eedf399e6c/roles/a26fe2ec418e475fb65528485c92428a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.708600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90790d-c085-4f17-b2d1-e4ac4cf8e0b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=9a40d290f0e147b9b62cf3eedf399e6c, role_id=a26fe2ec418e475fb65528485c92428a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:42.710051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90790d-c085-4f17-b2d1-e4ac4cf8e0b0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:42.722857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 315/634] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:04:42 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/9a40d290f0e147b9b62cf3eedf399e6c/roles/a26fe2ec418e475fb65528485c92428a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:42.723653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90790d-c085-4f17-b2d1-e4ac4cf8e0b0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:42.744825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 320/635] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:42.746539 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682d58-ef78-4902-b60d-ab800d245c8e None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.746828 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682d58-ef78-4902-b60d-ab800d245c8e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.747101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682d58-ef78-4902-b60d-ab800d245c8e None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.750357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 321/636] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:42.750357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65682d58-ef78-4902-b60d-ab800d245c8e None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:42.770592 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:42.853347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90790d-c085-4f17-b2d1-e4ac4cf8e0b0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:42.874056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65682d58-ef78-4902-b60d-ab800d245c8e None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:42.895760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa86b2-6ee7-4bd2-8f47-65c35cd387cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:42.896730 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa86b2-6ee7-4bd2-8f47-65c35cd387cb None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.897109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa86b2-6ee7-4bd2-8f47-65c35cd387cb None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.897477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa86b2-6ee7-4bd2-8f47-65c35cd387cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.908575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa86b2-6ee7-4bd2-8f47-65c35cd387cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:42.910064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa86b2-6ee7-4bd2-8f47-65c35cd387cb None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:42.914011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e05697-1570-464c-b289-2081091972ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:42.914931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e05697-1570-464c-b289-2081091972ad None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.915276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e05697-1570-464c-b289-2081091972ad None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.915611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e05697-1570-464c-b289-2081091972ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.926729 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e05697-1570-464c-b289-2081091972ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:42.928268 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e05697-1570-464c-b289-2081091972ad None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-06fa86b2-6ee7-4bd2-8f47-65c35cd387cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:42.931545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:42.932612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:42.933694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:42.933694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:42.933694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:42.933694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:42.934663 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 316/637] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:42.935890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b58e7e-021c-44ed-8732-34e14164a8c7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:42.936236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b58e7e-021c-44ed-8732-34e14164a8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:42.936567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b58e7e-021c-44ed-8732-34e14164a8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-e4e05697-1570-464c-b289-2081091972ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:42.948639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:42.949746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:42.950951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:42.950951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:42.950951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:42.950951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:42.951784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 322/638] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:42.952568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e05697-1570-464c-b289-2081091972ad None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:42.959741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d1b58e7e-021c-44ed-8732-34e14164a8c7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:42.961002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d1b58e7e-021c-44ed-8732-34e14164a8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:42.986513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:43.021222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:43.034091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 317/639] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:43.035290 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b58e7e-021c-44ed-8732-34e14164a8c7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:43.080661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e05697-1570-464c-b289-2081091972ad None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:43.120926 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9444d5f-a02b-4763-ab97-7ff9d613c165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:43.122107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9444d5f-a02b-4763-ab97-7ff9d613c165 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:43.122485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9444d5f-a02b-4763-ab97-7ff9d613c165 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:43.122828 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9444d5f-a02b-4763-ab97-7ff9d613c165 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:43.136627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9444d5f-a02b-4763-ab97-7ff9d613c165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:43.142250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b58e7e-021c-44ed-8732-34e14164a8c7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-b9444d5f-a02b-4763-ab97-7ff9d613c165 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:43.147043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:43.148180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:43.149209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:43.150329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 323/640] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:43.154995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9444d5f-a02b-4763-ab97-7ff9d613c165 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:43.180526 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd1ad1-a221-4744-935e-21e20db2b7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:43.181110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1ad1-a221-4744-935e-21e20db2b7cc None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:43.181399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1ad1-a221-4744-935e-21e20db2b7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:43.181649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1ad1-a221-4744-935e-21e20db2b7cc None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:43.182403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd1ad1-a221-4744-935e-21e20db2b7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:43.182705 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd1ad1-a221-4744-935e-21e20db2b7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:43.184122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd1ad1-a221-4744-935e-21e20db2b7cc None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:43.199211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 318/641] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:43.200285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd1ad1-a221-4744-935e-21e20db2b7cc None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:43.222263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:43.270054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9444d5f-a02b-4763-ab97-7ff9d613c165 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:43.295302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:43.303961 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd1ad1-a221-4744-935e-21e20db2b7cc None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:43.308232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57614-e741-4cd5-934e-0abb8f11b5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:43.308907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57614-e741-4cd5-934e-0abb8f11b5ec None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:43.309187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57614-e741-4cd5-934e-0abb8f11b5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:43.309460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57614-e741-4cd5-934e-0abb8f11b5ec None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:43.310184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c57614-e741-4cd5-934e-0abb8f11b5ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:43.310538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c57614-e741-4cd5-934e-0abb8f11b5ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:43.312371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c57614-e741-4cd5-934e-0abb8f11b5ec None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:43.327659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 324/642] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:43.328689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57614-e741-4cd5-934e-0abb8f11b5ec None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:43.344074 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f285c-aea4-4c54-b4d5-ceb769b03bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:43.345522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f285c-aea4-4c54-b4d5-ceb769b03bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:43.345810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f285c-aea4-4c54-b4d5-ceb769b03bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:43.346088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f285c-aea4-4c54-b4d5-ceb769b03bb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:43.357210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f285c-aea4-4c54-b4d5-ceb769b03bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-615f285c-aea4-4c54-b4d5-ceb769b03bb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:43.365446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:43.366487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:43.367372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 319/643] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:43.368080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f285c-aea4-4c54-b4d5-ceb769b03bb0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:43.438494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57614-e741-4cd5-934e-0abb8f11b5ec None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:43.453439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:43.476721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628b847-a922-45b0-a085-29ebf0dab856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:43.477404 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628b847-a922-45b0-a085-29ebf0dab856 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:43.477683 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628b847-a922-45b0-a085-29ebf0dab856 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:43.477952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628b847-a922-45b0-a085-29ebf0dab856 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:43.478748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628b847-a922-45b0-a085-29ebf0dab856 None admin] RBAC: Adding query filter params (name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:43.479025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f285c-aea4-4c54-b4d5-ceb769b03bb0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:43.479129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628b847-a922-45b0-a085-29ebf0dab856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:43.480440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628b847-a922-45b0-a085-29ebf0dab856 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:43.493256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 325/644] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:43.493256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628b847-a922-45b0-a085-29ebf0dab856 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:43.527034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fc05f-e6e8-4dfd-b035-92b96b4347ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:43.527926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fc05f-e6e8-4dfd-b035-92b96b4347ed None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:43.528278 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fc05f-e6e8-4dfd-b035-92b96b4347ed None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:43.528628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fc05f-e6e8-4dfd-b035-92b96b4347ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:43.537139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:43.538163 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fc05f-e6e8-4dfd-b035-92b96b4347ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:43.539716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fc05f-e6e8-4dfd-b035-92b96b4347ed None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-4a9fc05f-e6e8-4dfd-b035-92b96b4347ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:43.554311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:43.555319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 320/645] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Jun 28 03:04:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:43.556428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fc05f-e6e8-4dfd-b035-92b96b4347ed None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:43.599173 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628b847-a922-45b0-a085-29ebf0dab856 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:43.635008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ee55a-af06-4aed-b3b5-945eb1f053e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:43.635963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ee55a-af06-4aed-b3b5-945eb1f053e1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:43.636338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ee55a-af06-4aed-b3b5-945eb1f053e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:43.637061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ee55a-af06-4aed-b3b5-945eb1f053e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:43.645513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ee55a-af06-4aed-b3b5-945eb1f053e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:43.647023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ee55a-af06-4aed-b3b5-945eb1f053e1 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-870ee55a-af06-4aed-b3b5-945eb1f053e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:43.661635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:43.668791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:43.670467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:43.670467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:43.670467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:43.670467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:43.670467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:43.670467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:43.670467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:43.670467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:43.671055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fc05f-e6e8-4dfd-b035-92b96b4347ed None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:43.671140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 326/646] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:43.671140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ee55a-af06-4aed-b3b5-945eb1f053e1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:43.709135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418bc6c-3eff-4edb-a109-00d34da4d278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:43.710260 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418bc6c-3eff-4edb-a109-00d34da4d278 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:43.710831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418bc6c-3eff-4edb-a109-00d34da4d278 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:43.711356 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418bc6c-3eff-4edb-a109-00d34da4d278 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:43.712641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418bc6c-3eff-4edb-a109-00d34da4d278 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:43.713224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418bc6c-3eff-4edb-a109-00d34da4d278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:43.715543 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418bc6c-3eff-4edb-a109-00d34da4d278 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:43.731345 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 321/647] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:43.732316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418bc6c-3eff-4edb-a109-00d34da4d278 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:43.735599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:43.795652 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ee55a-af06-4aed-b3b5-945eb1f053e1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:43.804834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:43.835532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ca8e-f32d-4366-9416-339911dcab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:43.836447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ca8e-f32d-4366-9416-339911dcab43 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:43.836796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ca8e-f32d-4366-9416-339911dcab43 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:43.837133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ca8e-f32d-4366-9416-339911dcab43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:43.847303 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418bc6c-3eff-4edb-a109-00d34da4d278 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:43.848249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7ca8e-f32d-4366-9416-339911dcab43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:43.849780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7ca8e-f32d-4366-9416-339911dcab43 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-4db7ca8e-f32d-4366-9416-339911dcab43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:43.868522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:43.869633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:43.870746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:43.870746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:43.870746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:43.870746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:43.871217 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 327/648] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:43.871988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ca8e-f32d-4366-9416-339911dcab43 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:43.889578 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069a249-654b-4d39-a974-2ad2751baf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:43.890591 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a249-654b-4d39-a974-2ad2751baf8e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:43.890972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a249-654b-4d39-a974-2ad2751baf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:43.891363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a249-654b-4d39-a974-2ad2751baf8e None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:43.892286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069a249-654b-4d39-a974-2ad2751baf8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:43.892665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069a249-654b-4d39-a974-2ad2751baf8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:43.894172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069a249-654b-4d39-a974-2ad2751baf8e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:43.916386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 322/649] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Jun 28 03:04:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:43.916386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069a249-654b-4d39-a974-2ad2751baf8e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:43.976006 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:43.981209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ca8e-f32d-4366-9416-339911dcab43 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:44.015018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2031d-42f8-44c7-a0cb-39cb63ca516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:44.015687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2031d-42f8-44c7-a0cb-39cb63ca516f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:44.015967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2031d-42f8-44c7-a0cb-39cb63ca516f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:44.016238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2031d-42f8-44c7-a0cb-39cb63ca516f None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:44.017207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2031d-42f8-44c7-a0cb-39cb63ca516f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:44.017513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2031d-42f8-44c7-a0cb-39cb63ca516f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:44.018973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2031d-42f8-44c7-a0cb-39cb63ca516f None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:44.026496 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069a249-654b-4d39-a974-2ad2751baf8e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:44.031164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 328/650] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:44.031769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2031d-42f8-44c7-a0cb-39cb63ca516f None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:44.067933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:44.072441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a06db6-28d7-424e-884b-40816dadcb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:44.073264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a06db6-28d7-424e-884b-40816dadcb30 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:44.073540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a06db6-28d7-424e-884b-40816dadcb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:44.073825 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a06db6-28d7-424e-884b-40816dadcb30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:44.085891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a06db6-28d7-424e-884b-40816dadcb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:44.087414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a06db6-28d7-424e-884b-40816dadcb30 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-29a06db6-28d7-424e-884b-40816dadcb30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:44.106640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:44.107761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:44.108805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:44.108805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:44.108805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:44.108805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:44.108805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 323/651] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:44.111480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a06db6-28d7-424e-884b-40816dadcb30 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:44.183955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2031d-42f8-44c7-a0cb-39cb63ca516f None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:44.219774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a06db6-28d7-424e-884b-40816dadcb30 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:44.220341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01395f7-04cd-49a6-8f01-cc5419bdba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:44.221156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01395f7-04cd-49a6-8f01-cc5419bdba43 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:44.221506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01395f7-04cd-49a6-8f01-cc5419bdba43 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:44.221843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01395f7-04cd-49a6-8f01-cc5419bdba43 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:44.222676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01395f7-04cd-49a6-8f01-cc5419bdba43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:44.223058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01395f7-04cd-49a6-8f01-cc5419bdba43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:44.224498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01395f7-04cd-49a6-8f01-cc5419bdba43 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:44.234207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:44.241845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 329/652] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:44.241845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01395f7-04cd-49a6-8f01-cc5419bdba43 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:44.261960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e4a10-7134-4a54-a078-472de7384b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:44.262655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e4a10-7134-4a54-a078-472de7384b0d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:44.262937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e4a10-7134-4a54-a078-472de7384b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:44.263213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e4a10-7134-4a54-a078-472de7384b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:44.325659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:44.333598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e4a10-7134-4a54-a078-472de7384b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:44.335104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e4a10-7134-4a54-a078-472de7384b0d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:44.350510 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01395f7-04cd-49a6-8f01-cc5419bdba43 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:44.387103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c75d4-449c-4ed3-abf6-fdc127bf08c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:44.387772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c75d4-449c-4ed3-abf6-fdc127bf08c1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:44.388050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c75d4-449c-4ed3-abf6-fdc127bf08c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:44.388323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c75d4-449c-4ed3-abf6-fdc127bf08c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:44.389156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c75d4-449c-4ed3-abf6-fdc127bf08c1 None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=70604923ae0b4a4dae21de1314cddbf6) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:44.389462 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c75d4-449c-4ed3-abf6-fdc127bf08c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:44.390923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c75d4-449c-4ed3-abf6-fdc127bf08c1 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:44.397939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 330/653] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:44 2022] GET /identity/v3/role_assignments?user.id=70604923ae0b4a4dae21de1314cddbf6&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:44.398778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c75d4-449c-4ed3-abf6-fdc127bf08c1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:44.465191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 324/654] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:44.466616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e4a10-7134-4a54-a078-472de7384b0d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:44.483285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:44.517827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c75d4-449c-4ed3-abf6-fdc127bf08c1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:44.555664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f61b88-4772-4e6e-85f0-105b37ec233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:44.556354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61b88-4772-4e6e-85f0-105b37ec233a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:44.556636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61b88-4772-4e6e-85f0-105b37ec233a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:44.556911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61b88-4772-4e6e-85f0-105b37ec233a None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:44.557657 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f61b88-4772-4e6e-85f0-105b37ec233a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:44.557961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f61b88-4772-4e6e-85f0-105b37ec233a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:44.559429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f61b88-4772-4e6e-85f0-105b37ec233a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:44.578156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 331/655] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:44.578156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f61b88-4772-4e6e-85f0-105b37ec233a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:44.583161 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:44.592173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e4a10-7134-4a54-a078-472de7384b0d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:44.631635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67876d5e-f40d-4a9a-86bc-4b4366048a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:44.632273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67876d5e-f40d-4a9a-86bc-4b4366048a57 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:44.632558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67876d5e-f40d-4a9a-86bc-4b4366048a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:44.632833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67876d5e-f40d-4a9a-86bc-4b4366048a57 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:44.643442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67876d5e-f40d-4a9a-86bc-4b4366048a57 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:44.644631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67876d5e-f40d-4a9a-86bc-4b4366048a57 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-67876d5e-f40d-4a9a-86bc-4b4366048a57 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:44.660642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:44.661629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:44.662599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:44.662599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:44.662599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:44.662599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:44.662599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:44.662599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:44.662599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:44.662599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:44.662599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 03:04:44.662599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:44.662599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 325/656] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:44.663194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67876d5e-f40d-4a9a-86bc-4b4366048a57 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:44.713413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f61b88-4772-4e6e-85f0-105b37ec233a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:44.753507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fc001-e498-41dd-95f1-c913632595ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:44.754609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fc001-e498-41dd-95f1-c913632595ad None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:44.755065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fc001-e498-41dd-95f1-c913632595ad None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:44.755334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fc001-e498-41dd-95f1-c913632595ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:44.760035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:44.766243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fc001-e498-41dd-95f1-c913632595ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:44.767795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fc001-e498-41dd-95f1-c913632595ad None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-032fc001-e498-41dd-95f1-c913632595ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:44.786659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:44.787562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:44.788447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:44.788447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:44.788447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:44.788447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:44.788447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 332/657] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:44.788717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fc001-e498-41dd-95f1-c913632595ad None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:44.797912 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67876d5e-f40d-4a9a-86bc-4b4366048a57 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:44.833287 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab82bf9-4f9f-46c6-b696-1745bb95c0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:44.834102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab82bf9-4f9f-46c6-b696-1745bb95c0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:44.834414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab82bf9-4f9f-46c6-b696-1745bb95c0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:44.834698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab82bf9-4f9f-46c6-b696-1745bb95c0b8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:44.842082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab82bf9-4f9f-46c6-b696-1745bb95c0b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:44.843587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab82bf9-4f9f-46c6-b696-1745bb95c0b8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:44.845688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-5ab82bf9-4f9f-46c6-b696-1745bb95c0b8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:44.860559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:44.861661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 326/658] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:44.863182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212922a-2a43-4d11-b3c2-38a8e964bcd2 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:44.863866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212922a-2a43-4d11-b3c2-38a8e964bcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:44.863866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212922a-2a43-4d11-b3c2-38a8e964bcd2 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:44.869381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 327/659] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:44.869381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212922a-2a43-4d11-b3c2-38a8e964bcd2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:44.903017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fc001-e498-41dd-95f1-c913632595ad None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:44.938034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195064f1-7e20-4ebe-9021-219db71e9b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:44.939098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195064f1-7e20-4ebe-9021-219db71e9b74 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:44.939384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195064f1-7e20-4ebe-9021-219db71e9b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:44.939656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195064f1-7e20-4ebe-9021-219db71e9b74 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:44.940501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195064f1-7e20-4ebe-9021-219db71e9b74 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:44.940808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195064f1-7e20-4ebe-9021-219db71e9b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:44.942265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195064f1-7e20-4ebe-9021-219db71e9b74 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:44.966058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 333/660] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Jun 28 03:04:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:44.966927 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195064f1-7e20-4ebe-9021-219db71e9b74 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:44.969369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212922a-2a43-4d11-b3c2-38a8e964bcd2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:45.001103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:45.008520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c02bc-a56b-4df1-a489-47d4f4acc683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:45.009625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c02bc-a56b-4df1-a489-47d4f4acc683 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:45.009904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c02bc-a56b-4df1-a489-47d4f4acc683 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:45.010172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c02bc-a56b-4df1-a489-47d4f4acc683 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:45.011343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c02bc-a56b-4df1-a489-47d4f4acc683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:45.011651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c02bc-a56b-4df1-a489-47d4f4acc683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:45.013594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c02bc-a56b-4df1-a489-47d4f4acc683 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:45.031990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 328/661] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:45.031990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5c63a-b06d-4836-92c1-15a01a71ea14 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:45.031990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5c63a-b06d-4836-92c1-15a01a71ea14 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:45.031990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5c63a-b06d-4836-92c1-15a01a71ea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:45.050979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-03c5c63a-b06d-4836-92c1-15a01a71ea14 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:45.052166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-03c5c63a-b06d-4836-92c1-15a01a71ea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:45.072775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195064f1-7e20-4ebe-9021-219db71e9b74 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:45.086810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:45.113129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e466855-b60d-43ba-a661-5e3c9b54289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:45.113808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e466855-b60d-43ba-a661-5e3c9b54289e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:45.114084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e466855-b60d-43ba-a661-5e3c9b54289e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:45.114380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e466855-b60d-43ba-a661-5e3c9b54289e None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:45.115581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e466855-b60d-43ba-a661-5e3c9b54289e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:45.116124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e466855-b60d-43ba-a661-5e3c9b54289e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:45.117298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e466855-b60d-43ba-a661-5e3c9b54289e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:45.123516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 329/662] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:45.124196 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5c63a-b06d-4836-92c1-15a01a71ea14 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:45.143834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 334/663] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Jun 28 03:04:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:45.143834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e466855-b60d-43ba-a661-5e3c9b54289e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:45.231976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5c63a-b06d-4836-92c1-15a01a71ea14 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:45.250650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e466855-b60d-43ba-a661-5e3c9b54289e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:45.255343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:45.267429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cad99-1d26-4849-b71c-d700ed6b293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:45.268101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cad99-1d26-4849-b71c-d700ed6b293a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:45.268386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cad99-1d26-4849-b71c-d700ed6b293a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:45.268660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cad99-1d26-4849-b71c-d700ed6b293a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:45.291125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1f796-31f3-4e1d-984e-f1232fcf6ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:45.291947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1f796-31f3-4e1d-984e-f1232fcf6ffa None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:45.292237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1f796-31f3-4e1d-984e-f1232fcf6ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:45.292477 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1f796-31f3-4e1d-984e-f1232fcf6ffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:45.299628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1f796-31f3-4e1d-984e-f1232fcf6ffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:45.301020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1f796-31f3-4e1d-984e-f1232fcf6ffa None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-87f1f796-31f3-4e1d-984e-f1232fcf6ffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:45.315205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:45.316104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:45.316995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:45.316995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:45.316995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:45.316995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:45.316995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:45.316995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:45.316995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:45.316995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:45.316995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 335/664] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:45.318122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1f796-31f3-4e1d-984e-f1232fcf6ffa None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:45.344623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cad99-1d26-4849-b71c-d700ed6b293a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:45.346352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cad99-1d26-4849-b71c-d700ed6b293a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:45.350124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:45.424373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1f796-31f3-4e1d-984e-f1232fcf6ffa None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:45.445950 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 330/665] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:45.446830 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cad99-1d26-4849-b71c-d700ed6b293a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:45.463969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52445ea7-b473-4dfe-9baa-b8f33328ae4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:45.465002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445ea7-b473-4dfe-9baa-b8f33328ae4a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:45.465576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445ea7-b473-4dfe-9baa-b8f33328ae4a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:45.465914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445ea7-b473-4dfe-9baa-b8f33328ae4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:45.471050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:45.544585 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52445ea7-b473-4dfe-9baa-b8f33328ae4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:45.546057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52445ea7-b473-4dfe-9baa-b8f33328ae4a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:45.556944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cad99-1d26-4849-b71c-d700ed6b293a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:45.576513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:45.592936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c566-70f3-4da1-ba24-e31bf95a24a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:45.593905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c566-70f3-4da1-ba24-e31bf95a24a5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:45.594182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c566-70f3-4da1-ba24-e31bf95a24a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:45.594506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c566-70f3-4da1-ba24-e31bf95a24a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:45.605133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9c566-70f3-4da1-ba24-e31bf95a24a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-95c9c566-70f3-4da1-ba24-e31bf95a24a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:45.612983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:45.613946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:45.614851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:45.619294 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 331/666] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:45.620207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c566-70f3-4da1-ba24-e31bf95a24a5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:45.661494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 336/667] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:45.661494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52445ea7-b473-4dfe-9baa-b8f33328ae4a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:45.711738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:45.731805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c566-70f3-4da1-ba24-e31bf95a24a5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:45.762475 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52445ea7-b473-4dfe-9baa-b8f33328ae4a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:45.768137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615bcfc-8fec-46a3-acb6-8a5a5e61d1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:45.768841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615bcfc-8fec-46a3-acb6-8a5a5e61d1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:45.769123 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615bcfc-8fec-46a3-acb6-8a5a5e61d1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:45.769395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615bcfc-8fec-46a3-acb6-8a5a5e61d1c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:45.770188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615bcfc-8fec-46a3-acb6-8a5a5e61d1c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:45.770531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615bcfc-8fec-46a3-acb6-8a5a5e61d1c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:45.771993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615bcfc-8fec-46a3-acb6-8a5a5e61d1c1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:45.786699 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 332/668] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:45.787539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615bcfc-8fec-46a3-acb6-8a5a5e61d1c1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:45.799634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:45.805968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a782e7-9c9e-401e-8500-afe8a2f13d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:45.806824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a782e7-9c9e-401e-8500-afe8a2f13d01 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:45.807151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a782e7-9c9e-401e-8500-afe8a2f13d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:45.807360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a782e7-9c9e-401e-8500-afe8a2f13d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:45.820062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a782e7-9c9e-401e-8500-afe8a2f13d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:45.821543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a782e7-9c9e-401e-8500-afe8a2f13d01 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-a9a782e7-9c9e-401e-8500-afe8a2f13d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:45.839985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:45.840931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:45.841809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:45.841809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:45.841809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:45.841809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:45.841809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 337/669] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:45.842081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a782e7-9c9e-401e-8500-afe8a2f13d01 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:45.917980 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615bcfc-8fec-46a3-acb6-8a5a5e61d1c1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:45.946916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a782e7-9c9e-401e-8500-afe8a2f13d01 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:45.952728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93a401-0473-4645-a312-c7f0cd924a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:45.953413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93a401-0473-4645-a312-c7f0cd924a9f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:45.953695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93a401-0473-4645-a312-c7f0cd924a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:45.954135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93a401-0473-4645-a312-c7f0cd924a9f None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:45.954935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93a401-0473-4645-a312-c7f0cd924a9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:45.955244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93a401-0473-4645-a312-c7f0cd924a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:45.956626 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93a401-0473-4645-a312-c7f0cd924a9f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:45.969619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 333/670] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:45.969619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93a401-0473-4645-a312-c7f0cd924a9f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:45.972383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:45.989454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fdaf2-cb07-4f19-b352-505a43e3f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:45.990659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fdaf2-cb07-4f19-b352-505a43e3f71e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:45.990942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fdaf2-cb07-4f19-b352-505a43e3f71e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:45.991213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fdaf2-cb07-4f19-b352-505a43e3f71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.001385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fdaf2-cb07-4f19-b352-505a43e3f71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:46.003068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fdaf2-cb07-4f19-b352-505a43e3f71e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-2d7fdaf2-cb07-4f19-b352-505a43e3f71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:46.021360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:46.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:46.023234 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:46.023234 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:46.023234 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:46.023234 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:46.024846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 338/671] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:46.025763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fdaf2-cb07-4f19-b352-505a43e3f71e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:46.064126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:46.088779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93a401-0473-4645-a312-c7f0cd924a9f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:46.125294 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7e3c-6c05-4821-affc-ffccfa9cf488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:46.126121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7e3c-6c05-4821-affc-ffccfa9cf488 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.126435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7e3c-6c05-4821-affc-ffccfa9cf488 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.126826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7e3c-6c05-4821-affc-ffccfa9cf488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.127662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed7e3c-6c05-4821-affc-ffccfa9cf488 None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=b1868e9d8b004c4fb781e532c775428e) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:46.127981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed7e3c-6c05-4821-affc-ffccfa9cf488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:46.129425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed7e3c-6c05-4821-affc-ffccfa9cf488 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:46.129686 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fdaf2-cb07-4f19-b352-505a43e3f71e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:46.139807 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 334/672] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:45 2022] GET /identity/v3/role_assignments?user.id=b1868e9d8b004c4fb781e532c775428e&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:46.139807 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7e3c-6c05-4821-affc-ffccfa9cf488 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:46.180029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d366-b139-4788-9fc2-f4af4a66adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:46.181317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d366-b139-4788-9fc2-f4af4a66adde None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.181749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d366-b139-4788-9fc2-f4af4a66adde None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.182168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d366-b139-4788-9fc2-f4af4a66adde None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.183592 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26d366-b139-4788-9fc2-f4af4a66adde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:46.184202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26d366-b139-4788-9fc2-f4af4a66adde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:46.185978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26d366-b139-4788-9fc2-f4af4a66adde None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:46.206958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 339/673] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:46.208129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d366-b139-4788-9fc2-f4af4a66adde None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:46.227373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:46.267080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed7e3c-6c05-4821-affc-ffccfa9cf488 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:46.308687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b4b37-588d-4f97-a49e-819efb6709c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:46.309548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b4b37-588d-4f97-a49e-819efb6709c6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.309789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b4b37-588d-4f97-a49e-819efb6709c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.310137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b4b37-588d-4f97-a49e-819efb6709c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.322838 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:46.324118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b4b37-588d-4f97-a49e-819efb6709c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:46.325596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b4b37-588d-4f97-a49e-819efb6709c6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:46.333095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d366-b139-4788-9fc2-f4af4a66adde None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d14b4b37-588d-4f97-a49e-819efb6709c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:46.343943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:46.345130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:46.346181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:46.346181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:46.346181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:46.346181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:46.346181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 335/674] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:46.346505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b4b37-588d-4f97-a49e-819efb6709c6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:46.374398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e73615-b835-4db3-9f05-fdcaac210df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:46.375325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e73615-b835-4db3-9f05-fdcaac210df5 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.375826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e73615-b835-4db3-9f05-fdcaac210df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.376365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e73615-b835-4db3-9f05-fdcaac210df5 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.377384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e73615-b835-4db3-9f05-fdcaac210df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:46.377911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e73615-b835-4db3-9f05-fdcaac210df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:46.379497 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e73615-b835-4db3-9f05-fdcaac210df5 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:46.396491 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 340/675] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:46.397651 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e73615-b835-4db3-9f05-fdcaac210df5 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:46.467808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b4b37-588d-4f97-a49e-819efb6709c6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:46.490805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:46.513178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440b9b1-bfd1-4411-9f38-c5a850db6c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:46.514255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b9b1-bfd1-4411-9f38-c5a850db6c09 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.514568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b9b1-bfd1-4411-9f38-c5a850db6c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.515088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b9b1-bfd1-4411-9f38-c5a850db6c09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.523368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e73615-b835-4db3-9f05-fdcaac210df5 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:46.524317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440b9b1-bfd1-4411-9f38-c5a850db6c09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:46.526974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440b9b1-bfd1-4411-9f38-c5a850db6c09 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-e440b9b1-bfd1-4411-9f38-c5a850db6c09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:46.552739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:46.553690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:46.554637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:46.554637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:46.554637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:46.554637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:46.554637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:46.554637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:46.554637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:46.554637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:46.556024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 336/676] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:46.556966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440b9b1-bfd1-4411-9f38-c5a850db6c09 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:46.564320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83da12-9d4a-4def-ae00-f6e7dd05883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:46.565360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83da12-9d4a-4def-ae00-f6e7dd05883e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.565845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83da12-9d4a-4def-ae00-f6e7dd05883e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.566390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83da12-9d4a-4def-ae00-f6e7dd05883e None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.567344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83da12-9d4a-4def-ae00-f6e7dd05883e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:46.567850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83da12-9d4a-4def-ae00-f6e7dd05883e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:46.570065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83da12-9d4a-4def-ae00-f6e7dd05883e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:46.586650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 341/677] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:46.587829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83da12-9d4a-4def-ae00-f6e7dd05883e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:46.609066 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:46.674231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440b9b1-bfd1-4411-9f38-c5a850db6c09 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:46.709760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709a1ee-ca70-4acb-9157-b60ed2abef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:46.710597 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709a1ee-ca70-4acb-9157-b60ed2abef11 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.710880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709a1ee-ca70-4acb-9157-b60ed2abef11 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.711149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709a1ee-ca70-4acb-9157-b60ed2abef11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.716066 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83da12-9d4a-4def-ae00-f6e7dd05883e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:46.718110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709a1ee-ca70-4acb-9157-b60ed2abef11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:46.719750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709a1ee-ca70-4acb-9157-b60ed2abef11 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b709a1ee-ca70-4acb-9157-b60ed2abef11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:46.733977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:46.735136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:46.736138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:46.736138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:46.736138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:46.736138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:46.736138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:46.736138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:46.736138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:46.736138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:46.736138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 337/678] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:46.736138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709a1ee-ca70-4acb-9157-b60ed2abef11 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:46.758141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ee290-9433-44e3-a28e-fccadb9b4fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:46.758862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ee290-9433-44e3-a28e-fccadb9b4fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.759147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ee290-9433-44e3-a28e-fccadb9b4fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.759445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ee290-9433-44e3-a28e-fccadb9b4fc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.760785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ee290-9433-44e3-a28e-fccadb9b4fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:46.761105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ee290-9433-44e3-a28e-fccadb9b4fc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:46.762747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ee290-9433-44e3-a28e-fccadb9b4fc3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:46.785034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 342/679] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:46.785034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cff1e5-8993-4c39-a3b4-a5c2f8712d90 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.785034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cff1e5-8993-4c39-a3b4-a5c2f8712d90 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.785034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cff1e5-8993-4c39-a3b4-a5c2f8712d90 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.785034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 343/680] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:46.785034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cff1e5-8993-4c39-a3b4-a5c2f8712d90 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:46.787936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:46.848736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709a1ee-ca70-4acb-9157-b60ed2abef11 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:46.860772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:46.884146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212016b-0cbf-437d-8fbc-f96bedce4cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:46.884913 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212016b-0cbf-437d-8fbc-f96bedce4cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.885371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212016b-0cbf-437d-8fbc-f96bedce4cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.885486 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212016b-0cbf-437d-8fbc-f96bedce4cc8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.889489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cff1e5-8993-4c39-a3b4-a5c2f8712d90 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:46.893527 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212016b-0cbf-437d-8fbc-f96bedce4cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:46.895044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212016b-0cbf-437d-8fbc-f96bedce4cc8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-6212016b-0cbf-437d-8fbc-f96bedce4cc8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:46.910398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:46.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 338/681] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91ced-3166-4f2f-b232-71391c2a3a1f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.917596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91ced-3166-4f2f-b232-71391c2a3a1f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.918439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91ced-3166-4f2f-b232-71391c2a3a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.933100 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9aa91ced-3166-4f2f-b232-71391c2a3a1f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:46.934351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9aa91ced-3166-4f2f-b232-71391c2a3a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:46.936008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fc0b9-dfd8-4636-893e-1b471d6809bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:46.936796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fc0b9-dfd8-4636-893e-1b471d6809bb None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:46.937106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fc0b9-dfd8-4636-893e-1b471d6809bb None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:46.937376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fc0b9-dfd8-4636-893e-1b471d6809bb None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:46.938269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fc0b9-dfd8-4636-893e-1b471d6809bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:46.938598 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fc0b9-dfd8-4636-893e-1b471d6809bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:46.940029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fc0b9-dfd8-4636-893e-1b471d6809bb None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:46.952502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 344/682] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:46.953609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fc0b9-dfd8-4636-893e-1b471d6809bb None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:47.011992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 339/683] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:47.013304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa91ced-3166-4f2f-b232-71391c2a3a1f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:47.048534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:47.071835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fc0b9-dfd8-4636-893e-1b471d6809bb None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:47.106448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3a73b-c195-49cd-9ca8-2107c21ac0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:47.107072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3a73b-c195-49cd-9ca8-2107c21ac0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:47.107352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3a73b-c195-49cd-9ca8-2107c21ac0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:47.107821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3a73b-c195-49cd-9ca8-2107c21ac0e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:47.108576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3a73b-c195-49cd-9ca8-2107c21ac0e7 None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=d7e0632bc12346b38663a0ef97ab1a99) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:47.108893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3a73b-c195-49cd-9ca8-2107c21ac0e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:47.110599 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3a73b-c195-49cd-9ca8-2107c21ac0e7 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:47.112460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:47.122509 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 345/684] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:46 2022] GET /identity/v3/role_assignments?user.id=d7e0632bc12346b38663a0ef97ab1a99&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:47.125347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3a73b-c195-49cd-9ca8-2107c21ac0e7 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:47.127109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa91ced-3166-4f2f-b232-71391c2a3a1f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:47.167576 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3a682-1b84-43f2-ad10-e8984969d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:47.168280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a682-1b84-43f2-ad10-e8984969d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:47.168564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a682-1b84-43f2-ad10-e8984969d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:47.168840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a682-1b84-43f2-ad10-e8984969d7e3 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:47.169716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3a682-1b84-43f2-ad10-e8984969d7e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:47.170026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3a682-1b84-43f2-ad10-e8984969d7e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:47.171691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3a682-1b84-43f2-ad10-e8984969d7e3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:47.197151 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 340/685] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Jun 28 03:04:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:47.197151 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3a682-1b84-43f2-ad10-e8984969d7e3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:47.282066 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3a73b-c195-49cd-9ca8-2107c21ac0e7 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:47.311621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:47.327165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4c621-6995-4e2d-b1a7-bc716ea50f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:47.327534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3a682-1b84-43f2-ad10-e8984969d7e3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:47.328315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c621-6995-4e2d-b1a7-bc716ea50f4b None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:47.328595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c621-6995-4e2d-b1a7-bc716ea50f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:47.329031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c621-6995-4e2d-b1a7-bc716ea50f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:47.329968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4c621-6995-4e2d-b1a7-bc716ea50f4b None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=0f8a5bc11b6745a196337b4dc48de14e) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:47.330280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4c621-6995-4e2d-b1a7-bc716ea50f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:47.331780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4c621-6995-4e2d-b1a7-bc716ea50f4b None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:47.339002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 346/686] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:47 2022] GET /identity/v3/role_assignments?user.id=0f8a5bc11b6745a196337b4dc48de14e&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:47.339852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4c621-6995-4e2d-b1a7-bc716ea50f4b None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:47.378693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b537319-6719-4893-a649-e8211d5025d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:47.379680 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b537319-6719-4893-a649-e8211d5025d1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:47.380071 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b537319-6719-4893-a649-e8211d5025d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:47.380350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b537319-6719-4893-a649-e8211d5025d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:47.392506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b537319-6719-4893-a649-e8211d5025d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:47.394174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b537319-6719-4893-a649-e8211d5025d1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-7b537319-6719-4893-a649-e8211d5025d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:47.415219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:47.416195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:47.417279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:47.417279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:47.417279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:47.417279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:47.417279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 341/687] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:47.421936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:47.424124 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b537319-6719-4893-a649-e8211d5025d1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:47.472743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4c621-6995-4e2d-b1a7-bc716ea50f4b None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:47.512031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9ee11-6c2a-4021-bfc4-2985d6b53669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:47.512713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ee11-6c2a-4021-bfc4-2985d6b53669 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:47.512997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ee11-6c2a-4021-bfc4-2985d6b53669 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:47.513269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ee11-6c2a-4021-bfc4-2985d6b53669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:47.582512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b537319-6719-4893-a649-e8211d5025d1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:47.622525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9ee11-6c2a-4021-bfc4-2985d6b53669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:47.624082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9ee11-6c2a-4021-bfc4-2985d6b53669 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:47.624986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d97483-8520-4be8-933c-48cfbf820e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:47.625778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d97483-8520-4be8-933c-48cfbf820e86 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:47.626063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d97483-8520-4be8-933c-48cfbf820e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:47.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d97483-8520-4be8-933c-48cfbf820e86 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:47.627109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d97483-8520-4be8-933c-48cfbf820e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:47.627416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d97483-8520-4be8-933c-48cfbf820e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:47.628960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d97483-8520-4be8-933c-48cfbf820e86 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:47.638593 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:47.645928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 342/688] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:47.648374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d97483-8520-4be8-933c-48cfbf820e86 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:47.704329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:47.751821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 347/689] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:47.757654 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9ee11-6c2a-4021-bfc4-2985d6b53669 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:47.762091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d97483-8520-4be8-933c-48cfbf820e86 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:47.831447 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd6060-4fe2-4bc0-a36c-ebc4ee5102fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:47.832133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd6060-4fe2-4bc0-a36c-ebc4ee5102fd None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:47.832416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd6060-4fe2-4bc0-a36c-ebc4ee5102fd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:47.832690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd6060-4fe2-4bc0-a36c-ebc4ee5102fd None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:47.833408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd6060-4fe2-4bc0-a36c-ebc4ee5102fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:47.834887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd6060-4fe2-4bc0-a36c-ebc4ee5102fd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:47.875245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 343/690] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:04:47 2022] POST /identity/v3/users => generated 254 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:04:47.895897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9ee11-6c2a-4021-bfc4-2985d6b53669 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:47.942630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903d4ef-1970-443f-a325-806c5ce43a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:47.943501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903d4ef-1970-443f-a325-806c5ce43a38 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:47.943803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903d4ef-1970-443f-a325-806c5ce43a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:47.944116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903d4ef-1970-443f-a325-806c5ce43a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:47.962417 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903d4ef-1970-443f-a325-806c5ce43a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:47.963936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903d4ef-1970-443f-a325-806c5ce43a38 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-b903d4ef-1970-443f-a325-806c5ce43a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:47.988336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:47.989327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:47.991045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:47.991045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:47.991045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:47.991045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:47.991045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 348/691] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:47.997326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd6060-4fe2-4bc0-a36c-ebc4ee5102fd None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:48.066327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:48.112918 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd6060-4fe2-4bc0-a36c-ebc4ee5102fd None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:48.150864 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc617d21-98e7-43c9-975e-cd1c6011cd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:48.151484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc617d21-98e7-43c9-975e-cd1c6011cd6b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:48.151762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc617d21-98e7-43c9-975e-cd1c6011cd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:48.152037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc617d21-98e7-43c9-975e-cd1c6011cd6b None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:48.152777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc617d21-98e7-43c9-975e-cd1c6011cd6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:48.153088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc617d21-98e7-43c9-975e-cd1c6011cd6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:48.154509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc617d21-98e7-43c9-975e-cd1c6011cd6b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:48.168102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 344/692] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:48.174331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903d4ef-1970-443f-a325-806c5ce43a38 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:48.196866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:48.304537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903d4ef-1970-443f-a325-806c5ce43a38 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:48.343801 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06312df-2db5-49b0-9ad8-25e4efe356c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:48.345154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06312df-2db5-49b0-9ad8-25e4efe356c0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:48.345702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06312df-2db5-49b0-9ad8-25e4efe356c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:48.346163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06312df-2db5-49b0-9ad8-25e4efe356c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:48.353870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06312df-2db5-49b0-9ad8-25e4efe356c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:48.355701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06312df-2db5-49b0-9ad8-25e4efe356c0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-d06312df-2db5-49b0-9ad8-25e4efe356c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:48.370529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:48.371443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:48.372356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:48.372356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:48.372356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:48.372356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:48.372356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:48.372356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:48.372356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:48.372356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:48.378414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 349/693] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:48.383490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc617d21-98e7-43c9-975e-cd1c6011cd6b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:48.504061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc617d21-98e7-43c9-975e-cd1c6011cd6b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:48.522686 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:48.540792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca1c9a-c167-4680-96f2-4ce85464a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:48.541482 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca1c9a-c167-4680-96f2-4ce85464a254 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:48.541764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca1c9a-c167-4680-96f2-4ce85464a254 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:48.542040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca1c9a-c167-4680-96f2-4ce85464a254 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:48.542895 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca1c9a-c167-4680-96f2-4ce85464a254 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:48.543205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca1c9a-c167-4680-96f2-4ce85464a254 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:48.544672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca1c9a-c167-4680-96f2-4ce85464a254 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:48.559810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 345/694] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:48.565991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06312df-2db5-49b0-9ad8-25e4efe356c0 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:48.667104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:48.696320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06312df-2db5-49b0-9ad8-25e4efe356c0 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:48.735002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e606d-3dea-461d-b4c0-410877d9f693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:48.736155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e606d-3dea-461d-b4c0-410877d9f693 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:48.736647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e606d-3dea-461d-b4c0-410877d9f693 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:48.737103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e606d-3dea-461d-b4c0-410877d9f693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:48.738127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e606d-3dea-461d-b4c0-410877d9f693 None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=9a40d290f0e147b9b62cf3eedf399e6c) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:48.738680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e606d-3dea-461d-b4c0-410877d9f693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:48.740691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e606d-3dea-461d-b4c0-410877d9f693 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:48.754516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 350/695] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:48 2022] GET /identity/v3/role_assignments?user.id=9a40d290f0e147b9b62cf3eedf399e6c&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:48.836639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f185179-01ff-486a-9928-a9cb35a2d63f None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:48.837170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f185179-01ff-486a-9928-a9cb35a2d63f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:48.837284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f185179-01ff-486a-9928-a9cb35a2d63f None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:48.838981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 346/696] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:48.845072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb07e8-ebdd-4d1d-89ae-89d9161685cb None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:48.845390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb07e8-ebdd-4d1d-89ae-89d9161685cb None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:48.845818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb07e8-ebdd-4d1d-89ae-89d9161685cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:48.871411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e7cb07e8-ebdd-4d1d-89ae-89d9161685cb None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:48.872659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e7cb07e8-ebdd-4d1d-89ae-89d9161685cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:48.961920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 351/697] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:48.987948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f185179-01ff-486a-9928-a9cb35a2d63f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:49.126511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f185179-01ff-486a-9928-a9cb35a2d63f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:49.163939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847ab88-adb6-49bb-8095-a62688e6f633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:49.164752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ab88-adb6-49bb-8095-a62688e6f633 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:49.165033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ab88-adb6-49bb-8095-a62688e6f633 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:49.165308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ab88-adb6-49bb-8095-a62688e6f633 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:49.176269 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847ab88-adb6-49bb-8095-a62688e6f633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-5847ab88-adb6-49bb-8095-a62688e6f633 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:49.183937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:49.184828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:49.185936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 347/698] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:49.191153 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb07e8-ebdd-4d1d-89ae-89d9161685cb None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:49.268979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:49.305401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb07e8-ebdd-4d1d-89ae-89d9161685cb None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:49.338982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48422fd-18f4-4c58-b426-9ac279ab7013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:49.339658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48422fd-18f4-4c58-b426-9ac279ab7013 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:49.339937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48422fd-18f4-4c58-b426-9ac279ab7013 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:49.340205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48422fd-18f4-4c58-b426-9ac279ab7013 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:49.340946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48422fd-18f4-4c58-b426-9ac279ab7013 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:49.341247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48422fd-18f4-4c58-b426-9ac279ab7013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:49.344223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48422fd-18f4-4c58-b426-9ac279ab7013 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:49.353668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 352/699] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:49.358813 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847ab88-adb6-49bb-8095-a62688e6f633 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:49.427371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:49.510236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847ab88-adb6-49bb-8095-a62688e6f633 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:49.563421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b69e6b-e052-4296-b97e-5150ddd08078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:49.564157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b69e6b-e052-4296-b97e-5150ddd08078 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:49.564442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b69e6b-e052-4296-b97e-5150ddd08078 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:49.564720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b69e6b-e052-4296-b97e-5150ddd08078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:49.582049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b69e6b-e052-4296-b97e-5150ddd08078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:49.583561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b69e6b-e052-4296-b97e-5150ddd08078 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d4b69e6b-e052-4296-b97e-5150ddd08078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:49.606122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:49.607104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:49.607986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:49.607986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:49.607986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:49.607986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:49.607986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 348/700] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:49.619435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48422fd-18f4-4c58-b426-9ac279ab7013 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:49.730529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d135d7b-4be5-4e98-9ee2-3ad27f74b1ac None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:49.730866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d135d7b-4be5-4e98-9ee2-3ad27f74b1ac None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:49.731097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d135d7b-4be5-4e98-9ee2-3ad27f74b1ac None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:49.732503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 349/701] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:04:49.738488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc00e3-45de-4dd9-a43d-baaacde5dad5 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:49.738801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc00e3-45de-4dd9-a43d-baaacde5dad5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:49.739032 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc00e3-45de-4dd9-a43d-baaacde5dad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:49.760540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48422fd-18f4-4c58-b426-9ac279ab7013 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:49.772279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5ddc00e3-45de-4dd9-a43d-baaacde5dad5 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:49.773476 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5ddc00e3-45de-4dd9-a43d-baaacde5dad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:49.822074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:49.831233 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc44b8-d447-4d2e-8082-f57c8be6da6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:49.831919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc44b8-d447-4d2e-8082-f57c8be6da6a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:49.832197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc44b8-d447-4d2e-8082-f57c8be6da6a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:49.832468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc44b8-d447-4d2e-8082-f57c8be6da6a None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:49.833199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc44b8-d447-4d2e-8082-f57c8be6da6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:49.833499 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc44b8-d447-4d2e-8082-f57c8be6da6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:49.834934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc44b8-d447-4d2e-8082-f57c8be6da6a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:49.849370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 353/702] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:49.854703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc44b8-d447-4d2e-8082-f57c8be6da6a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:49.897825 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 350/703] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:49.921412 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc00e3-45de-4dd9-a43d-baaacde5dad5 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:49.951884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:50.052199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc44b8-d447-4d2e-8082-f57c8be6da6a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:50.098175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc00e3-45de-4dd9-a43d-baaacde5dad5 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:50.110025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a429e-d73c-48e9-8b8a-4462f8c55e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:50.110947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a429e-d73c-48e9-8b8a-4462f8c55e31 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.111231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a429e-d73c-48e9-8b8a-4462f8c55e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.111507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a429e-d73c-48e9-8b8a-4462f8c55e31 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.123465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a429e-d73c-48e9-8b8a-4462f8c55e31 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:50.124931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a429e-d73c-48e9-8b8a-4462f8c55e31 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-807a429e-d73c-48e9-8b8a-4462f8c55e31 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:50.142817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:50.143894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:50.144834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:50.144834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:50.144834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:50.144834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:50.144834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:50.144834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:50.144834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:50.144834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:50.144834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:04:50.144834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:50.149740 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 354/704] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Jun 28 03:04:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:50.149740 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f12d32-8970-4f5f-ba0a-25f129523ede None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.149740 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f12d32-8970-4f5f-ba0a-25f129523ede None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.149740 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f12d32-8970-4f5f-ba0a-25f129523ede None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.150637 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 355/705] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:50.151357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f12d32-8970-4f5f-ba0a-25f129523ede None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:50.166000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5abc5e-11e6-4631-bdfd-f2fd43e0b669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:50.167207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5abc5e-11e6-4631-bdfd-f2fd43e0b669 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.167491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5abc5e-11e6-4631-bdfd-f2fd43e0b669 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.168080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5abc5e-11e6-4631-bdfd-f2fd43e0b669 None admin] PATH_INFO: `/v3/services/network` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.169120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5abc5e-11e6-4631-bdfd-f2fd43e0b669 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:50.170684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5abc5e-11e6-4631-bdfd-f2fd43e0b669 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-9e5abc5e-11e6-4631-bdfd-f2fd43e0b669 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:50.188571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:50.190926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:50.192788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 351/706] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:49 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:50.194148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cbb6d-529a-4fa3-8275-d033dd746bb1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.194148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cbb6d-529a-4fa3-8275-d033dd746bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.194148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cbb6d-529a-4fa3-8275-d033dd746bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.211689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:50.213982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e88cbb6d-529a-4fa3-8275-d033dd746bb1 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:50.215265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e88cbb6d-529a-4fa3-8275-d033dd746bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:50.267595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f12d32-8970-4f5f-ba0a-25f129523ede None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:50.306585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 352/707] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:50.307639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cbb6d-529a-4fa3-8275-d033dd746bb1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:50.314894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ecb55-ec16-4b0d-b004-6dd50cc3632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:50.316543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ecb55-ec16-4b0d-b004-6dd50cc3632f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.316827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ecb55-ec16-4b0d-b004-6dd50cc3632f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.317105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ecb55-ec16-4b0d-b004-6dd50cc3632f None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.318022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ecb55-ec16-4b0d-b004-6dd50cc3632f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:50.318348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ecb55-ec16-4b0d-b004-6dd50cc3632f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:50.319951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ecb55-ec16-4b0d-b004-6dd50cc3632f None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:50.338749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:50.342889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 356/708] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Jun 28 03:04:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:50.344926 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ecb55-ec16-4b0d-b004-6dd50cc3632f None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:50.458270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cbb6d-529a-4fa3-8275-d033dd746bb1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:50.466402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ecb55-ec16-4b0d-b004-6dd50cc3632f None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:50.479516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:50.501365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c37a7-4522-40ce-9df9-16007953277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:50.502325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c37a7-4522-40ce-9df9-16007953277e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.503028 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c37a7-4522-40ce-9df9-16007953277e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.503309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c37a7-4522-40ce-9df9-16007953277e None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.504306 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c37a7-4522-40ce-9df9-16007953277e None admin] RBAC: Adding query filter params (name=network) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:50.504855 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c37a7-4522-40ce-9df9-16007953277e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:50.506942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c37a7-4522-40ce-9df9-16007953277e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:50.510568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6297788-48a5-48d4-9d50-159be8954bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:50.511514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297788-48a5-48d4-9d50-159be8954bce None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.511891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297788-48a5-48d4-9d50-159be8954bce None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.512253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297788-48a5-48d4-9d50-159be8954bce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.512518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 353/709] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:04:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:50.513111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6297788-48a5-48d4-9d50-159be8954bce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:50.513328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c37a7-4522-40ce-9df9-16007953277e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:50.514804 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6297788-48a5-48d4-9d50-159be8954bce None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-f6297788-48a5-48d4-9d50-159be8954bce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:50.529494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:50.530736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 03:04:50.532024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:50.538368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 357/710] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Jun 28 03:04:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:50.539311 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6297788-48a5-48d4-9d50-159be8954bce None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:50.615194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:50.643270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c37a7-4522-40ce-9df9-16007953277e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:50.652055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6297788-48a5-48d4-9d50-159be8954bce None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:50.680351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdf1c3-cb75-4da4-ae15-37155cc5f549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:50.681285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdf1c3-cb75-4da4-ae15-37155cc5f549 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.681723 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdf1c3-cb75-4da4-ae15-37155cc5f549 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.682174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdf1c3-cb75-4da4-ae15-37155cc5f549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.689991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12565c5d-e280-46e2-826b-501d6446945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:50.690802 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12565c5d-e280-46e2-826b-501d6446945d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.691216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12565c5d-e280-46e2-826b-501d6446945d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.691531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12565c5d-e280-46e2-826b-501d6446945d None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.692339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12565c5d-e280-46e2-826b-501d6446945d None admin] RBAC: Adding query filter params (type=network) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:50.692709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12565c5d-e280-46e2-826b-501d6446945d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:50.694307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12565c5d-e280-46e2-826b-501d6446945d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:50.701015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 358/711] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:04:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:50.701958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12565c5d-e280-46e2-826b-501d6446945d None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:50.742846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:50.778794 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdf1c3-cb75-4da4-ae15-37155cc5f549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:50.780859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdf1c3-cb75-4da4-ae15-37155cc5f549 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:50.819975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12565c5d-e280-46e2-826b-501d6446945d None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:50.860364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c7c41-e2d1-4a22-9d31-345636a48764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:50.861988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c7c41-e2d1-4a22-9d31-345636a48764 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.861988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c7c41-e2d1-4a22-9d31-345636a48764 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.861988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c7c41-e2d1-4a22-9d31-345636a48764 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.862813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c7c41-e2d1-4a22-9d31-345636a48764 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:50.863184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c7c41-e2d1-4a22-9d31-345636a48764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:50.864659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c7c41-e2d1-4a22-9d31-345636a48764 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:50.875294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 359/712] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Jun 28 03:04:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:50.876490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:50.878783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eb1a4-09c2-47d8-8777-6b3866396674 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.882467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eb1a4-09c2-47d8-8777-6b3866396674 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.882467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eb1a4-09c2-47d8-8777-6b3866396674 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.882467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 360/713] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:50.882467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71eb1a4-09c2-47d8-8777-6b3866396674 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:50.898852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 354/714] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:50.900551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1edb-ce9a-4f65-a517-fff9f7d9f9fa None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:50.900826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1edb-ce9a-4f65-a517-fff9f7d9f9fa None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:50.901102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1edb-ce9a-4f65-a517-fff9f7d9f9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:50.919488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1e1e1edb-ce9a-4f65-a517-fff9f7d9f9fa None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:50.920846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1e1e1edb-ce9a-4f65-a517-fff9f7d9f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:50.995954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:51.001678 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71eb1a4-09c2-47d8-8777-6b3866396674 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:51.003640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 355/715] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:51.004510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e1edb-ce9a-4f65-a517-fff9f7d9f9fa None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:51.052631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36871a-9f0b-4582-b211-3477c35602a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:51.054707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36871a-9f0b-4582-b211-3477c35602a6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.055202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36871a-9f0b-4582-b211-3477c35602a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.055913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36871a-9f0b-4582-b211-3477c35602a6 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.057077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36871a-9f0b-4582-b211-3477c35602a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:51.057977 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36871a-9f0b-4582-b211-3477c35602a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:51.059640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36871a-9f0b-4582-b211-3477c35602a6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:51.067733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 361/716] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Jun 28 03:04:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:51.074516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36871a-9f0b-4582-b211-3477c35602a6 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:51.165858 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e1edb-ce9a-4f65-a517-fff9f7d9f9fa None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:51.178704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:51.208978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb890a3-9725-4c1f-95f9-4ff32decafed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:51.209806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb890a3-9725-4c1f-95f9-4ff32decafed None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.210089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb890a3-9725-4c1f-95f9-4ff32decafed None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.210394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb890a3-9725-4c1f-95f9-4ff32decafed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.227717 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb890a3-9725-4c1f-95f9-4ff32decafed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:51.227717 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb890a3-9725-4c1f-95f9-4ff32decafed None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-4cb890a3-9725-4c1f-95f9-4ff32decafed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:51.247289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:51.248251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:51.249166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:51.249166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:51.249166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:51.249166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:51.249166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 356/717] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:51.254962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb890a3-9725-4c1f-95f9-4ff32decafed None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:51.273894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36871a-9f0b-4582-b211-3477c35602a6 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:51.322950 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfcab9-514b-43f0-b3bd-e95f4fc395c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:51.323769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfcab9-514b-43f0-b3bd-e95f4fc395c8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.324144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfcab9-514b-43f0-b3bd-e95f4fc395c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.324459 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfcab9-514b-43f0-b3bd-e95f4fc395c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.338587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfcab9-514b-43f0-b3bd-e95f4fc395c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-4ecfcab9-514b-43f0-b3bd-e95f4fc395c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:51.347569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:51.348547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:51.349376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:51.353680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 362/718] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:51.354938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfcab9-514b-43f0-b3bd-e95f4fc395c8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:51.392768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:51.410960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb890a3-9725-4c1f-95f9-4ff32decafed None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:51.447153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20187e9-d595-4c1b-8a3d-c1caa2e2a2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:51.447842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20187e9-d595-4c1b-8a3d-c1caa2e2a2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.448125 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20187e9-d595-4c1b-8a3d-c1caa2e2a2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.448395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20187e9-d595-4c1b-8a3d-c1caa2e2a2c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.449122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20187e9-d595-4c1b-8a3d-c1caa2e2a2c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:51.449430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20187e9-d595-4c1b-8a3d-c1caa2e2a2c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:51.450866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20187e9-d595-4c1b-8a3d-c1caa2e2a2c4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:51.463555 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 357/719] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:51.464925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aab87-aca4-4977-b862-795b7a0eb271 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.465143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aab87-aca4-4977-b862-795b7a0eb271 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.465383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aab87-aca4-4977-b862-795b7a0eb271 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.471547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 358/720] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:51.472347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aab87-aca4-4977-b862-795b7a0eb271 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:51.472632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfcab9-514b-43f0-b3bd-e95f4fc395c8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:51.496661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:51.509121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12625614-8ee1-4164-ade1-87b7356411c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:51.509894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12625614-8ee1-4164-ade1-87b7356411c6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.510281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12625614-8ee1-4164-ade1-87b7356411c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.510787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12625614-8ee1-4164-ade1-87b7356411c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.511940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12625614-8ee1-4164-ade1-87b7356411c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:51.512537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12625614-8ee1-4164-ade1-87b7356411c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:51.514216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12625614-8ee1-4164-ade1-87b7356411c6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:51.525203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 363/721] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:51.526928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75047342-aa71-4266-8586-d93f7791a15d None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.527296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75047342-aa71-4266-8586-d93f7791a15d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.527639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75047342-aa71-4266-8586-d93f7791a15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.548867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-75047342-aa71-4266-8586-d93f7791a15d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:51.550237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-75047342-aa71-4266-8586-d93f7791a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:51.598257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aab87-aca4-4977-b862-795b7a0eb271 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:51.642339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 364/722] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:51.642339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75047342-aa71-4266-8586-d93f7791a15d None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:51.644247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28297fcc-3ae8-4db8-aea8-ec7ee051ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:51.645282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28297fcc-3ae8-4db8-aea8-ec7ee051ec7b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.645807 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28297fcc-3ae8-4db8-aea8-ec7ee051ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.646254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28297fcc-3ae8-4db8-aea8-ec7ee051ec7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.653779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:51.659102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28297fcc-3ae8-4db8-aea8-ec7ee051ec7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:51.660864 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28297fcc-3ae8-4db8-aea8-ec7ee051ec7b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-28297fcc-3ae8-4db8-aea8-ec7ee051ec7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:51.687631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:51.688733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:51.689665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:51.689665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:51.689665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:51.689665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:51.689665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:51.689665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:51.689665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:51.689665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:51.690622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 359/723] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:51.693015 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28297fcc-3ae8-4db8-aea8-ec7ee051ec7b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:51.751416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75047342-aa71-4266-8586-d93f7791a15d None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:51.775921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:51.791451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0985d-dc52-42c6-a255-600c148fda8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:51.792656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0985d-dc52-42c6-a255-600c148fda8a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.793242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0985d-dc52-42c6-a255-600c148fda8a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.793732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0985d-dc52-42c6-a255-600c148fda8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.799099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28297fcc-3ae8-4db8-aea8-ec7ee051ec7b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:51.805523 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0985d-dc52-42c6-a255-600c148fda8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:51.807356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0985d-dc52-42c6-a255-600c148fda8a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-ecf0985d-dc52-42c6-a255-600c148fda8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:51.827259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:51.828205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:51.829168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:51.829168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:51.829168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:51.829168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:51.831403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 365/724] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:51.832700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0985d-dc52-42c6-a255-600c148fda8a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:51.834102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501c27e-ef68-43d2-8008-fc5cd130d254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:51.834961 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501c27e-ef68-43d2-8008-fc5cd130d254 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.835242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501c27e-ef68-43d2-8008-fc5cd130d254 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.835518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501c27e-ef68-43d2-8008-fc5cd130d254 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.846761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501c27e-ef68-43d2-8008-fc5cd130d254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-f501c27e-ef68-43d2-8008-fc5cd130d254 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:51.854620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:51.855552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:51.856434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 360/725] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:51.857122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501c27e-ef68-43d2-8008-fc5cd130d254 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:51.916438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:51.957355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0985d-dc52-42c6-a255-600c148fda8a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:51.961022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501c27e-ef68-43d2-8008-fc5cd130d254 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:51.996000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb71ec7-5981-48b9-b30d-25ef7f52f39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:51.996668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5b8a7-cc1f-4927-a772-709fadf35b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:51.996818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb71ec7-5981-48b9-b30d-25ef7f52f39a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.997008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb71ec7-5981-48b9-b30d-25ef7f52f39a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.997219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb71ec7-5981-48b9-b30d-25ef7f52f39a None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.997950 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb71ec7-5981-48b9-b30d-25ef7f52f39a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:51.998257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb71ec7-5981-48b9-b30d-25ef7f52f39a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:51.998485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5b8a7-cc1f-4927-a772-709fadf35b12 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:51.998960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5b8a7-cc1f-4927-a772-709fadf35b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:51.999486 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5b8a7-cc1f-4927-a772-709fadf35b12 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:51.999681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb71ec7-5981-48b9-b30d-25ef7f52f39a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:52.000715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5b8a7-cc1f-4927-a772-709fadf35b12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:52.001334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5b8a7-cc1f-4927-a772-709fadf35b12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:52.003126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5b8a7-cc1f-4927-a772-709fadf35b12 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:52.007102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:52.013536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 361/726] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:52.014704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb71ec7-5981-48b9-b30d-25ef7f52f39a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:52.022103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 366/727] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:52.023317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5b8a7-cc1f-4927-a772-709fadf35b12 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:52.136122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb71ec7-5981-48b9-b30d-25ef7f52f39a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:52.161459 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5b8a7-cc1f-4927-a772-709fadf35b12 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:52.177828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4c9fd-c425-4645-b220-7981d9dbdc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:52.178786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4c9fd-c425-4645-b220-7981d9dbdc4e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:52.179064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4c9fd-c425-4645-b220-7981d9dbdc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:52.179779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4c9fd-c425-4645-b220-7981d9dbdc4e None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:52.180548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4c9fd-c425-4645-b220-7981d9dbdc4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:52.181122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4c9fd-c425-4645-b220-7981d9dbdc4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:52.182726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4c9fd-c425-4645-b220-7981d9dbdc4e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:52.193270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 362/728] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:52.194159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4c9fd-c425-4645-b220-7981d9dbdc4e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:52.201073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:52.213365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bc4f5-d6f7-4528-b734-16bbf8c07282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:52.214737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bc4f5-d6f7-4528-b734-16bbf8c07282 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:52.215017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bc4f5-d6f7-4528-b734-16bbf8c07282 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:52.215288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bc4f5-d6f7-4528-b734-16bbf8c07282 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:52.225885 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bc4f5-d6f7-4528-b734-16bbf8c07282 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:52.227397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bc4f5-d6f7-4528-b734-16bbf8c07282 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-0f4bc4f5-d6f7-4528-b734-16bbf8c07282 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:52.242766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:52.243763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:52.244700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:52.244700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:52.244700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:52.244700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:52.244700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:52.244700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:52.244700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:52.244700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:52.244700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:04:52.244700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:52.244700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 367/729] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Jun 28 03:04:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:52.245282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bc4f5-d6f7-4528-b734-16bbf8c07282 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:52.269541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:52.315405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4c9fd-c425-4645-b220-7981d9dbdc4e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:52.348371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bc4f5-d6f7-4528-b734-16bbf8c07282 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:52.353451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ff99-ea0d-4656-943a-083a677c6021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:52.354391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ff99-ea0d-4656-943a-083a677c6021 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:52.354864 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ff99-ea0d-4656-943a-083a677c6021 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:52.355330 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ff99-ea0d-4656-943a-083a677c6021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:52.356428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9ff99-ea0d-4656-943a-083a677c6021 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=b1868e9d8b004c4fb781e532c775428e) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:52.356931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9ff99-ea0d-4656-943a-083a677c6021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:52.358711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9ff99-ea0d-4656-943a-083a677c6021 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:52.366252 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 363/730] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:52 2022] GET /identity/v3/role_assignments?user.id=b1868e9d8b004c4fb781e532c775428e&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:52.367333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ff99-ea0d-4656-943a-083a677c6021 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:52.384846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5147635-3daf-4692-9c49-b486afb886dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:52.385682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5147635-3daf-4692-9c49-b486afb886dc None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:52.385937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5147635-3daf-4692-9c49-b486afb886dc None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:52.386210 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5147635-3daf-4692-9c49-b486afb886dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:52.397869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5147635-3daf-4692-9c49-b486afb886dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:52.399350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5147635-3daf-4692-9c49-b486afb886dc None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-e5147635-3daf-4692-9c49-b486afb886dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:52.418182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:52.419639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:52.421116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:52.421116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:52.421116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:52.421116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:52.421116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 368/731] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:52.425503 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5147635-3daf-4692-9c49-b486afb886dc None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:52.472100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:52.505239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ff99-ea0d-4656-943a-083a677c6021 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:52.532940 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:52.535581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5147635-3daf-4692-9c49-b486afb886dc None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:52.545831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce564725-6a84-432c-b796-f82c9a625627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:52.548344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce564725-6a84-432c-b796-f82c9a625627 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:52.548877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce564725-6a84-432c-b796-f82c9a625627 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:52.549367 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce564725-6a84-432c-b796-f82c9a625627 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:52.550628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce564725-6a84-432c-b796-f82c9a625627 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:52.551241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce564725-6a84-432c-b796-f82c9a625627 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:52.552924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce564725-6a84-432c-b796-f82c9a625627 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:52.573045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e45603-53c4-40f7-93b5-216cc44a6f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:52.573658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45603-53c4-40f7-93b5-216cc44a6f39 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:52.573932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45603-53c4-40f7-93b5-216cc44a6f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:52.574206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45603-53c4-40f7-93b5-216cc44a6f39 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:52.574998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e45603-53c4-40f7-93b5-216cc44a6f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:52.575296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e45603-53c4-40f7-93b5-216cc44a6f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:52.576519 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 364/732] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Jun 28 03:04:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:52.576749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e45603-53c4-40f7-93b5-216cc44a6f39 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:52.582837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce564725-6a84-432c-b796-f82c9a625627 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:52.592227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 369/733] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:52.598257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e45603-53c4-40f7-93b5-216cc44a6f39 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:52.699035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:52.701722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce564725-6a84-432c-b796-f82c9a625627 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:52.701842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e45603-53c4-40f7-93b5-216cc44a6f39 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:52.737773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522331be-a724-4aab-870e-7f14966d90ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:52.738615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522331be-a724-4aab-870e-7f14966d90ee None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:52.738899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522331be-a724-4aab-870e-7f14966d90ee None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:52.739170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522331be-a724-4aab-870e-7f14966d90ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:52.742977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79b80-3b14-4ed0-90b3-385eaf487085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:52.743953 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79b80-3b14-4ed0-90b3-385eaf487085 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:52.744477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79b80-3b14-4ed0-90b3-385eaf487085 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:52.744945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79b80-3b14-4ed0-90b3-385eaf487085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:52.747209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522331be-a724-4aab-870e-7f14966d90ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:52.748674 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522331be-a724-4aab-870e-7f14966d90ee None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-522331be-a724-4aab-870e-7f14966d90ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:52.763819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:52.764879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:52.765829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:52.765829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:52.765829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:52.765829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:52.765829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:52.765829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:52.765829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:52.765829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:52.765829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:04:52.765829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:52.765829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 370/734] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:04:52.770939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522331be-a724-4aab-870e-7f14966d90ee None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:52.803812 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:52.826022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a79b80-3b14-4ed0-90b3-385eaf487085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:52.827860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a79b80-3b14-4ed0-90b3-385eaf487085 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:52.875272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522331be-a724-4aab-870e-7f14966d90ee None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:52.911379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db51d5-30ab-4cfb-86f2-d8d40ec2ee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:52.911994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db51d5-30ab-4cfb-86f2-d8d40ec2ee7b None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:52.912273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db51d5-30ab-4cfb-86f2-d8d40ec2ee7b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:52.912542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db51d5-30ab-4cfb-86f2-d8d40ec2ee7b None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:52.913402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db51d5-30ab-4cfb-86f2-d8d40ec2ee7b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:52.913707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db51d5-30ab-4cfb-86f2-d8d40ec2ee7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:52.915403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db51d5-30ab-4cfb-86f2-d8d40ec2ee7b None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:52.934829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 371/735] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Jun 28 03:04:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:04:52.935384 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 365/736] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 03:04:52.940503 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db51d5-30ab-4cfb-86f2-d8d40ec2ee7b None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:52.941315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79b80-3b14-4ed0-90b3-385eaf487085 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:52.960567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:53.030693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:53.052439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79b80-3b14-4ed0-90b3-385eaf487085 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:53.083126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db51d5-30ab-4cfb-86f2-d8d40ec2ee7b None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:53.090860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb877083-0d4f-42d4-856b-58af5425f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:53.091959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb877083-0d4f-42d4-856b-58af5425f027 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:53.092456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb877083-0d4f-42d4-856b-58af5425f027 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:53.093015 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb877083-0d4f-42d4-856b-58af5425f027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:53.104769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb877083-0d4f-42d4-856b-58af5425f027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:53.106604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb877083-0d4f-42d4-856b-58af5425f027 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-fb877083-0d4f-42d4-856b-58af5425f027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:53.126460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:53.127424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:53.128348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:53.128348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:53.128348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:53.128348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:53.130683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 366/737] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:53.136237 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91562-1a5b-4d65-8396-db99de303241 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:53.136517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91562-1a5b-4d65-8396-db99de303241 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:53.136786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd91562-1a5b-4d65-8396-db99de303241 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:53.138237 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 367/738] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:53.139418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd91562-1a5b-4d65-8396-db99de303241 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:53.143938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8188fd-2050-46b0-a373-56eedb47e96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:53.144605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8188fd-2050-46b0-a373-56eedb47e96e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:53.144879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8188fd-2050-46b0-a373-56eedb47e96e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:53.145146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8188fd-2050-46b0-a373-56eedb47e96e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:53.221582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8188fd-2050-46b0-a373-56eedb47e96e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:53.223327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8188fd-2050-46b0-a373-56eedb47e96e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:53.246947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:53.259485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd91562-1a5b-4d65-8396-db99de303241 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:53.309484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7812f-1c8c-4576-8087-bd5b80d9ca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:53.311147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7812f-1c8c-4576-8087-bd5b80d9ca22 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:53.311438 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7812f-1c8c-4576-8087-bd5b80d9ca22 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:53.311712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7812f-1c8c-4576-8087-bd5b80d9ca22 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:53.312450 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7812f-1c8c-4576-8087-bd5b80d9ca22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:53.312756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7812f-1c8c-4576-8087-bd5b80d9ca22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:53.314185 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7812f-1c8c-4576-8087-bd5b80d9ca22 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:53.315874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:53.334637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 368/739] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:53.334637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e26c3e-1322-4f29-a1e7-ab6c12e1729a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:53.334637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e26c3e-1322-4f29-a1e7-ab6c12e1729a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:53.334637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e26c3e-1322-4f29-a1e7-ab6c12e1729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:53.351921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-12e26c3e-1322-4f29-a1e7-ab6c12e1729a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:53.353437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-12e26c3e-1322-4f29-a1e7-ab6c12e1729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:53.362460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 372/740] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 03:04:53.363698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8188fd-2050-46b0-a373-56eedb47e96e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:53.454255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 369/741] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:53.454255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e26c3e-1322-4f29-a1e7-ab6c12e1729a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:53.486055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8188fd-2050-46b0-a373-56eedb47e96e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:53.507585 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:53.526102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6413ce-b280-49d6-b219-603bdc48be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:53.526948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6413ce-b280-49d6-b219-603bdc48be4e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:53.527260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6413ce-b280-49d6-b219-603bdc48be4e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:53.527532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6413ce-b280-49d6-b219-603bdc48be4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:53.534590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6413ce-b280-49d6-b219-603bdc48be4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:53.535940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6413ce-b280-49d6-b219-603bdc48be4e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-6b6413ce-b280-49d6-b219-603bdc48be4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:53.550679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:53.551558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:53.552451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:53.552451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:53.552451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:53.552451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:53.552451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:53.552451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:53.552451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:53.552451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:53.552451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 373/742] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:53.553751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5719-2c52-4144-bf35-e66f5df72569 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:53.553751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5719-2c52-4144-bf35-e66f5df72569 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:53.553751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5719-2c52-4144-bf35-e66f5df72569 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:53.557553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 374/743] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:53.559395 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f5719-2c52-4144-bf35-e66f5df72569 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:53.580118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e26c3e-1322-4f29-a1e7-ab6c12e1729a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:53.606540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:53.619160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0898f4-a6d1-444a-8407-4cc1cf8d4f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:53.620076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0898f4-a6d1-444a-8407-4cc1cf8d4f4b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:53.620354 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0898f4-a6d1-444a-8407-4cc1cf8d4f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:53.620734 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0898f4-a6d1-444a-8407-4cc1cf8d4f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:53.632991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0898f4-a6d1-444a-8407-4cc1cf8d4f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:53.634486 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0898f4-a6d1-444a-8407-4cc1cf8d4f4b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-be0898f4-a6d1-444a-8407-4cc1cf8d4f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:53.653037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:53.653970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:53.655198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:53.655198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:53.655198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:53.655198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:53.655198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 370/744] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:53.655198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0898f4-a6d1-444a-8407-4cc1cf8d4f4b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:53.665572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f5719-2c52-4144-bf35-e66f5df72569 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:53.701940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985ea82-434c-4cef-8e7d-990ec38243cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:53.702658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985ea82-434c-4cef-8e7d-990ec38243cd None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:53.702940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985ea82-434c-4cef-8e7d-990ec38243cd None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:53.703211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985ea82-434c-4cef-8e7d-990ec38243cd None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:53.704030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985ea82-434c-4cef-8e7d-990ec38243cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:53.705423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985ea82-434c-4cef-8e7d-990ec38243cd None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:53.723188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 375/745] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:04:53 2022] POST /identity/v3/services => generated 240 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:04:53.724842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc7c93-edc1-4310-a632-1f9b45cb6650 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:53.725330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc7c93-edc1-4310-a632-1f9b45cb6650 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:53.725824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc7c93-edc1-4310-a632-1f9b45cb6650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:53.745972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8fbc7c93-edc1-4310-a632-1f9b45cb6650 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:53.747617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8fbc7c93-edc1-4310-a632-1f9b45cb6650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:53.788384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:53.795307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0898f4-a6d1-444a-8407-4cc1cf8d4f4b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:53.858441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d351559-0419-42cd-a481-5b1b82835d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:53.858441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d351559-0419-42cd-a481-5b1b82835d6c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:53.858441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d351559-0419-42cd-a481-5b1b82835d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:53.858441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d351559-0419-42cd-a481-5b1b82835d6c None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:53.858842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d351559-0419-42cd-a481-5b1b82835d6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:53.858842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d351559-0419-42cd-a481-5b1b82835d6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:53.858842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d351559-0419-42cd-a481-5b1b82835d6c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:53.859702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 376/746] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:53 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 03:04:53.861292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc7c93-edc1-4310-a632-1f9b45cb6650 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:53.873508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 371/747] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:53.881185 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d351559-0419-42cd-a481-5b1b82835d6c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:53.925682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:53.995503 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc7c93-edc1-4310-a632-1f9b45cb6650 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:54.011907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d351559-0419-42cd-a481-5b1b82835d6c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:54.030923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6521cd-3973-4550-8a1b-b0ff5180cbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:54.032111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6521cd-3973-4550-8a1b-b0ff5180cbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:54.032601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6521cd-3973-4550-8a1b-b0ff5180cbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:54.033119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6521cd-3973-4550-8a1b-b0ff5180cbb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:54.034049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6521cd-3973-4550-8a1b-b0ff5180cbb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:54.034596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6521cd-3973-4550-8a1b-b0ff5180cbb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:54.036333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6521cd-3973-4550-8a1b-b0ff5180cbb4 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:54.048790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74381ebb-b57b-4471-a716-02049c78c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:54.049462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74381ebb-b57b-4471-a716-02049c78c2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:54.049821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74381ebb-b57b-4471-a716-02049c78c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:54.049999 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74381ebb-b57b-4471-a716-02049c78c2e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:54.050514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 377/748] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:54.051594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6521cd-3973-4550-8a1b-b0ff5180cbb4 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:54.054960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74381ebb-b57b-4471-a716-02049c78c2e4 None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=a7d95e643b984955a20e48f71b204502) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:54.055522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74381ebb-b57b-4471-a716-02049c78c2e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:54.057492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74381ebb-b57b-4471-a716-02049c78c2e4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:54.068866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 372/749] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:53 2022] GET /identity/v3/role_assignments?user.id=a7d95e643b984955a20e48f71b204502&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:54.070490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74381ebb-b57b-4471-a716-02049c78c2e4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:54.088358 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:54.216371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6521cd-3973-4550-8a1b-b0ff5180cbb4 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:54.230085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:54.241415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74381ebb-b57b-4471-a716-02049c78c2e4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:54.287306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c8991-5af8-4c96-9bed-050661296a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:54.288912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c8991-5af8-4c96-9bed-050661296a01 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:54.289547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c8991-5af8-4c96-9bed-050661296a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:54.290023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c8991-5af8-4c96-9bed-050661296a01 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:54.291238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c8991-5af8-4c96-9bed-050661296a01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:54.292844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c8991-5af8-4c96-9bed-050661296a01 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:54.299780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f15598-1174-4443-8621-cfea3517eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:54.300811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15598-1174-4443-8621-cfea3517eae3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:54.301111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15598-1174-4443-8621-cfea3517eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:54.301435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15598-1174-4443-8621-cfea3517eae3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:54.310090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f15598-1174-4443-8621-cfea3517eae3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:54.311962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f15598-1174-4443-8621-cfea3517eae3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:54.313623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 378/750] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:04:54 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-e8f15598-1174-4443-8621-cfea3517eae3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:54.347493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:54.348466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:54.349362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:54.349362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:54.349362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:54.349362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:54.349362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:54.349362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:54.349362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:54.349362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:54.349362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 373/751] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:54.354962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c8991-5af8-4c96-9bed-050661296a01 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:54.503771 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c8991-5af8-4c96-9bed-050661296a01 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:54.505918 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:54.557552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ef0e-9a63-4e9b-ad94-00f669df02db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:54.558679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ef0e-9a63-4e9b-ad94-00f669df02db None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:54.559195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ef0e-9a63-4e9b-ad94-00f669df02db None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:54.559675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ef0e-9a63-4e9b-ad94-00f669df02db None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:54.560704 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2ef0e-9a63-4e9b-ad94-00f669df02db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:54.561255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2ef0e-9a63-4e9b-ad94-00f669df02db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:54.563043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2ef0e-9a63-4e9b-ad94-00f669df02db None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:54.577180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 379/752] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:54.582971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f15598-1174-4443-8621-cfea3517eae3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:54.705878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f15598-1174-4443-8621-cfea3517eae3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:54.744378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd9eac-ae84-4eec-9d79-29cec2d0e3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:54.745476 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9eac-ae84-4eec-9d79-29cec2d0e3ed None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:54.745960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9eac-ae84-4eec-9d79-29cec2d0e3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:54.746464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9eac-ae84-4eec-9d79-29cec2d0e3ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:54.747556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd9eac-ae84-4eec-9d79-29cec2d0e3ed None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=9a40d290f0e147b9b62cf3eedf399e6c) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:54.748090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd9eac-ae84-4eec-9d79-29cec2d0e3ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:54.749730 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd9eac-ae84-4eec-9d79-29cec2d0e3ed None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:54.757772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 374/753] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:04:54 2022] GET /identity/v3/role_assignments?user.id=9a40d290f0e147b9b62cf3eedf399e6c&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:54.767681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5ec7f-ef7e-4b3d-a2f4-fe259c1e7ad9 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:54.768356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5ec7f-ef7e-4b3d-a2f4-fe259c1e7ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:54.768832 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5ec7f-ef7e-4b3d-a2f4-fe259c1e7ad9 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:54.770565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 380/754] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:54.779720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efce81-2aa6-45d1-88db-056ad049c8d7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:54.780378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efce81-2aa6-45d1-88db-056ad049c8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:54.780873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efce81-2aa6-45d1-88db-056ad049c8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:54.807065 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-27efce81-2aa6-45d1-88db-056ad049c8d7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:54.810775 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-27efce81-2aa6-45d1-88db-056ad049c8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:54.828793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:54.909286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 375/755] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:04:54.943742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5ec7f-ef7e-4b3d-a2f4-fe259c1e7ad9 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:55.061721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5ec7f-ef7e-4b3d-a2f4-fe259c1e7ad9 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:55.118625 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaed42c-461e-4c5e-af1c-ee1f2b411140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:55.119440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaed42c-461e-4c5e-af1c-ee1f2b411140 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:55.119715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaed42c-461e-4c5e-af1c-ee1f2b411140 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:55.119983 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaed42c-461e-4c5e-af1c-ee1f2b411140 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:55.135375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:55.142785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaed42c-461e-4c5e-af1c-ee1f2b411140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-fbaed42c-461e-4c5e-af1c-ee1f2b411140 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:55.153400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:55.154394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:55.155226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:55.157669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 381/756] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:55.163976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efce81-2aa6-45d1-88db-056ad049c8d7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:55.275144 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efce81-2aa6-45d1-88db-056ad049c8d7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:55.313878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc09f8-4e9c-4d73-8f1f-83652fc10667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:55.314523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc09f8-4e9c-4d73-8f1f-83652fc10667 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:55.314812 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc09f8-4e9c-4d73-8f1f-83652fc10667 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:55.315089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc09f8-4e9c-4d73-8f1f-83652fc10667 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:55.315855 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc09f8-4e9c-4d73-8f1f-83652fc10667 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:55.316164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc09f8-4e9c-4d73-8f1f-83652fc10667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:55.317551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc09f8-4e9c-4d73-8f1f-83652fc10667 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:55.326612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 376/757] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:55.332443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaed42c-461e-4c5e-af1c-ee1f2b411140 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:55.493199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaed42c-461e-4c5e-af1c-ee1f2b411140 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:55.544833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7f248-03e4-4e81-b635-cf6dc9862c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:55.545651 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f248-03e4-4e81-b635-cf6dc9862c50 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:55.545928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f248-03e4-4e81-b635-cf6dc9862c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:55.546199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f248-03e4-4e81-b635-cf6dc9862c50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:55.562050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7f248-03e4-4e81-b635-cf6dc9862c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:55.563585 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7f248-03e4-4e81-b635-cf6dc9862c50 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-f5b7f248-03e4-4e81-b635-cf6dc9862c50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:55.583823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:55.584733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:55.585626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:55.585626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:55.585626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:55.585626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:55.585626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 382/758] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:55.591969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc09f8-4e9c-4d73-8f1f-83652fc10667 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:55.628962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:55.742764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc09f8-4e9c-4d73-8f1f-83652fc10667 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:55.777498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b47454-cc5d-4694-bda1-6a474d4dcca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:55.778179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47454-cc5d-4694-bda1-6a474d4dcca1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:55.778487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47454-cc5d-4694-bda1-6a474d4dcca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:55.778759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47454-cc5d-4694-bda1-6a474d4dcca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:55.779487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b47454-cc5d-4694-bda1-6a474d4dcca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:55.779791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b47454-cc5d-4694-bda1-6a474d4dcca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:55.781172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b47454-cc5d-4694-bda1-6a474d4dcca1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:55.794178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 377/759] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:55.799962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7f248-03e4-4e81-b635-cf6dc9862c50 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:55.872284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:55.930738 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7f248-03e4-4e81-b635-cf6dc9862c50 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:55.977815 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882782fa-e489-413f-a30a-8697a3c90a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:55.978668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882782fa-e489-413f-a30a-8697a3c90a02 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:55.978954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882782fa-e489-413f-a30a-8697a3c90a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:55.979225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882782fa-e489-413f-a30a-8697a3c90a02 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:55.987621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882782fa-e489-413f-a30a-8697a3c90a02 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:55.989083 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882782fa-e489-413f-a30a-8697a3c90a02 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-882782fa-e489-413f-a30a-8697a3c90a02 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:56.008797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:56.009803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:56.010798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:56.010798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:56.010798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:56.010798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:56.010798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:56.010798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:56.010798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:56.010798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:56.010798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:04:56.010798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:56.014397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 383/760] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Jun 28 03:04:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:56.019425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b47454-cc5d-4694-bda1-6a474d4dcca1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:56.145072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:56.179858 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b47454-cc5d-4694-bda1-6a474d4dcca1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:56.229695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f7618-2d5b-4b3a-be7d-30386442d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:56.230410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7618-2d5b-4b3a-be7d-30386442d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:56.230686 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7618-2d5b-4b3a-be7d-30386442d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:56.230952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7618-2d5b-4b3a-be7d-30386442d7a0 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:56.231790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f7618-2d5b-4b3a-be7d-30386442d7a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:56.232089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f7618-2d5b-4b3a-be7d-30386442d7a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:56.233527 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f7618-2d5b-4b3a-be7d-30386442d7a0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:56.252039 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 378/761] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Jun 28 03:04:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:56.257586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882782fa-e489-413f-a30a-8697a3c90a02 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:56.354319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed77007-c3d5-4ce2-8dcb-96a712dfb57b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:56.354657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed77007-c3d5-4ce2-8dcb-96a712dfb57b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:56.354867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed77007-c3d5-4ce2-8dcb-96a712dfb57b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:56.356509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 379/762] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:04:56.362974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7704fb-baee-452b-9a1e-62179513c101 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:56.363547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7704fb-baee-452b-9a1e-62179513c101 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:56.364038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7704fb-baee-452b-9a1e-62179513c101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:56.384588 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ad7704fb-baee-452b-9a1e-62179513c101 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:56.386118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ad7704fb-baee-452b-9a1e-62179513c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:56.388569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882782fa-e489-413f-a30a-8697a3c90a02 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:56.415678 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:56.446120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6e8ce-c247-40ed-aaba-0c9f772e1900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:56.446970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6e8ce-c247-40ed-aaba-0c9f772e1900 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:56.447254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6e8ce-c247-40ed-aaba-0c9f772e1900 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:56.447526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6e8ce-c247-40ed-aaba-0c9f772e1900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:56.472941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6e8ce-c247-40ed-aaba-0c9f772e1900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:56.474472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6e8ce-c247-40ed-aaba-0c9f772e1900 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-16e6e8ce-c247-40ed-aaba-0c9f772e1900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:56.501790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:56.502776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:56.503671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:56.503671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:56.503671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:56.503671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:56.503671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 384/763] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:56.515227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6e8ce-c247-40ed-aaba-0c9f772e1900 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:56.516044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 380/764] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:04:56.528062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9af01c-18b4-43b0-87fd-293626108428 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:56.528361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9af01c-18b4-43b0-87fd-293626108428 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:56.528634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9af01c-18b4-43b0-87fd-293626108428 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:56.530368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 381/765] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:56.537661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75de71-cb46-4839-b407-0b908852070e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:56.538001 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75de71-cb46-4839-b407-0b908852070e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:56.538314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75de71-cb46-4839-b407-0b908852070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:56.563864 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ef75de71-cb46-4839-b407-0b908852070e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:56.565053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ef75de71-cb46-4839-b407-0b908852070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:56.635888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:56.636483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6e8ce-c247-40ed-aaba-0c9f772e1900 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:56.660131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 382/766] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:04:56.660131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75de71-cb46-4839-b407-0b908852070e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:56.699126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8f513-739c-4e96-85bd-4357316eea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:56.699886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8f513-739c-4e96-85bd-4357316eea50 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:56.700249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8f513-739c-4e96-85bd-4357316eea50 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:56.701135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8f513-739c-4e96-85bd-4357316eea50 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:56.701974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8f513-739c-4e96-85bd-4357316eea50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:56.702535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8f513-739c-4e96-85bd-4357316eea50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:56.705230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8f513-739c-4e96-85bd-4357316eea50 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:56.726555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 385/767] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:56.727735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8f513-739c-4e96-85bd-4357316eea50 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:56.763147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:56.791190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75de71-cb46-4839-b407-0b908852070e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:56.832129 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af968483-d2f8-47ed-adab-5b8897f3c7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:56.833328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af968483-d2f8-47ed-adab-5b8897f3c7db None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:56.833810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af968483-d2f8-47ed-adab-5b8897f3c7db None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:56.834323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af968483-d2f8-47ed-adab-5b8897f3c7db None admin] PATH_INFO: `/v3/services/network` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:56.835182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af968483-d2f8-47ed-adab-5b8897f3c7db None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:56.836764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af968483-d2f8-47ed-adab-5b8897f3c7db None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-af968483-d2f8-47ed-adab-5b8897f3c7db None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:56.849504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:56.850547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 03:04:56.851464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:56.858846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 383/768] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:56 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:56.859994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8f513-739c-4e96-85bd-4357316eea50 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:56.860410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af968483-d2f8-47ed-adab-5b8897f3c7db None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:56.906378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42b9c9-c990-48ba-a276-690d75d4e89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:56.908366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b9c9-c990-48ba-a276-690d75d4e89e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:56.908648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b9c9-c990-48ba-a276-690d75d4e89e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:56.908935 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b9c9-c990-48ba-a276-690d75d4e89e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:56.923624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:56.923920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42b9c9-c990-48ba-a276-690d75d4e89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-4f42b9c9-c990-48ba-a276-690d75d4e89e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:56.935418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:56.936354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:04:56.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:56.942490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 386/769] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:04:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:56.943476 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42b9c9-c990-48ba-a276-690d75d4e89e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:56.979483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af968483-d2f8-47ed-adab-5b8897f3c7db None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:57.021000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d14e7-49fd-48d4-80d8-209f9dbf02cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:57.021980 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d14e7-49fd-48d4-80d8-209f9dbf02cf None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.022368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d14e7-49fd-48d4-80d8-209f9dbf02cf None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.022643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d14e7-49fd-48d4-80d8-209f9dbf02cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.031218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d14e7-49fd-48d4-80d8-209f9dbf02cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:57.034219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d14e7-49fd-48d4-80d8-209f9dbf02cf None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-5c3d14e7-49fd-48d4-80d8-209f9dbf02cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:57.054760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:57.055630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:57.056510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:57.056510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:57.056510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:57.056510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:57.056510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:57.056510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:57.056510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:57.056510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:57.061007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 384/770] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:57.061743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d14e7-49fd-48d4-80d8-209f9dbf02cf None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:57.062767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:57.078473 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42b9c9-c990-48ba-a276-690d75d4e89e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:57.124964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dcc48-8804-46b6-8eb7-85704eceb02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:57.126315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dcc48-8804-46b6-8eb7-85704eceb02e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.126766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dcc48-8804-46b6-8eb7-85704eceb02e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.127258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dcc48-8804-46b6-8eb7-85704eceb02e None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.128382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dcc48-8804-46b6-8eb7-85704eceb02e None admin] RBAC: Adding query filter params (name=network) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:57.128382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dcc48-8804-46b6-8eb7-85704eceb02e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:57.130377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dcc48-8804-46b6-8eb7-85704eceb02e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:57.135769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 387/771] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:04:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:57.136744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dcc48-8804-46b6-8eb7-85704eceb02e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:57.181248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d14e7-49fd-48d4-80d8-209f9dbf02cf None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:57.197572 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:57.220514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb7e22-b380-4d18-9dd5-93456c7fe147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:57.221195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb7e22-b380-4d18-9dd5-93456c7fe147 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.221480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb7e22-b380-4d18-9dd5-93456c7fe147 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.221749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb7e22-b380-4d18-9dd5-93456c7fe147 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.222520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb7e22-b380-4d18-9dd5-93456c7fe147 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:57.222821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb7e22-b380-4d18-9dd5-93456c7fe147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:57.224200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb7e22-b380-4d18-9dd5-93456c7fe147 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:57.232312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 385/772] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:04:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:57.233477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9495-b271-4c12-aa9e-e833af6e19a0 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.233758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9495-b271-4c12-aa9e-e833af6e19a0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.234025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9495-b271-4c12-aa9e-e833af6e19a0 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.238323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 386/773] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:57.238323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e9495-b271-4c12-aa9e-e833af6e19a0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:57.257748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dcc48-8804-46b6-8eb7-85704eceb02e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:57.290599 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b464a-1c9b-41c8-aa73-d910637a9919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:57.291270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b464a-1c9b-41c8-aa73-d910637a9919 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.291549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b464a-1c9b-41c8-aa73-d910637a9919 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.291821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b464a-1c9b-41c8-aa73-d910637a9919 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.292611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b464a-1c9b-41c8-aa73-d910637a9919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:57.292920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b464a-1c9b-41c8-aa73-d910637a9919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:57.294381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b464a-1c9b-41c8-aa73-d910637a9919 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:57.306482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 388/774] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:57.307260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b464a-1c9b-41c8-aa73-d910637a9919 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:57.318039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:57.336362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e9495-b271-4c12-aa9e-e833af6e19a0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:57.369374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3819988-ed64-4de7-8d06-e811a381e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:57.370044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3819988-ed64-4de7-8d06-e811a381e90a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.370349 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3819988-ed64-4de7-8d06-e811a381e90a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.370625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3819988-ed64-4de7-8d06-e811a381e90a None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.371329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3819988-ed64-4de7-8d06-e811a381e90a None admin] RBAC: Adding query filter params (type=network) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:57.371631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3819988-ed64-4de7-8d06-e811a381e90a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:57.373002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3819988-ed64-4de7-8d06-e811a381e90a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:57.379554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 387/775] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:04:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:57.380722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25584a2d-1069-4eeb-835c-569a4cd37273 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.381002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25584a2d-1069-4eeb-835c-569a4cd37273 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.381274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25584a2d-1069-4eeb-835c-569a4cd37273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.397647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-25584a2d-1069-4eeb-835c-569a4cd37273 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:57.399742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-25584a2d-1069-4eeb-835c-569a4cd37273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:57.407011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b464a-1c9b-41c8-aa73-d910637a9919 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:57.436404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:57.443941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3268ea2-bcf5-4e77-bb49-be7603960d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:57.444756 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268ea2-bcf5-4e77-bb49-be7603960d96 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.445035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268ea2-bcf5-4e77-bb49-be7603960d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.445303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268ea2-bcf5-4e77-bb49-be7603960d96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.455862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3268ea2-bcf5-4e77-bb49-be7603960d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:57.457318 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3268ea2-bcf5-4e77-bb49-be7603960d96 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:57.470545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 388/776] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:04:57.471860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a03635-98fe-4018-9d6c-0f0e5f86ed58 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.472148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a03635-98fe-4018-9d6c-0f0e5f86ed58 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.472424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a03635-98fe-4018-9d6c-0f0e5f86ed58 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.473831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 389/777] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-e3268ea2-bcf5-4e77-bb49-be7603960d96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:57.474921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:57.475763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:57.476650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:57.476650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:57.476650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:57.476650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:57.476650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 389/778] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:57.477253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3268ea2-bcf5-4e77-bb49-be7603960d96 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:57.478441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a03635-98fe-4018-9d6c-0f0e5f86ed58 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:57.543596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:57.579164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a03635-98fe-4018-9d6c-0f0e5f86ed58 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:57.585520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3268ea2-bcf5-4e77-bb49-be7603960d96 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:57.612751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3ad4b-af1b-4c93-89b2-2d9cdb9a6e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:57.613647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ad4b-af1b-4c93-89b2-2d9cdb9a6e55 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.613925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ad4b-af1b-4c93-89b2-2d9cdb9a6e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.614188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ad4b-af1b-4c93-89b2-2d9cdb9a6e55 None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/b1868e9d8b004c4fb781e532c775428e/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.616583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3ad4b-af1b-4c93-89b2-2d9cdb9a6e55 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=b1868e9d8b004c4fb781e532c775428e, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:57.618030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3ad4b-af1b-4c93-89b2-2d9cdb9a6e55 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:57.621064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749740c-f5b2-4302-bed3-c14ca04eefb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:57.621711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749740c-f5b2-4302-bed3-c14ca04eefb1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.622021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749740c-f5b2-4302-bed3-c14ca04eefb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.622362 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749740c-f5b2-4302-bed3-c14ca04eefb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.623264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749740c-f5b2-4302-bed3-c14ca04eefb1 None admin] RBAC: Adding query filter params (interface=public, service_id=332956888517432b98d07d133f9e2b23, region_id=RegionOne) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:57.623781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749740c-f5b2-4302-bed3-c14ca04eefb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:57.625469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749740c-f5b2-4302-bed3-c14ca04eefb1 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:57.632063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 390/779] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:04:57 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/b1868e9d8b004c4fb781e532c775428e/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:04:57.633300 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04527067-5737-4c03-abd3-e3728e04176d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.633582 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04527067-5737-4c03-abd3-e3728e04176d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.633853 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04527067-5737-4c03-abd3-e3728e04176d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.636128 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 390/780] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Jun 28 03:04:57 2022] GET /identity/v3/endpoints?service_id=332956888517432b98d07d133f9e2b23&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:57.637290 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749740c-f5b2-4302-bed3-c14ca04eefb1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:57.656341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-04527067-5737-4c03-abd3-e3728e04176d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:57.657639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-04527067-5737-4c03-abd3-e3728e04176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:57.686177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:57.736064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 391/781] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:04:57.737044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04527067-5737-4c03-abd3-e3728e04176d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:57.774025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749740c-f5b2-4302-bed3-c14ca04eefb1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:57.801068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:57.815101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172e070-4abb-40e8-b886-5854d6b74d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:57.815781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e070-4abb-40e8-b886-5854d6b74d38 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.816059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e070-4abb-40e8-b886-5854d6b74d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.816326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e070-4abb-40e8-b886-5854d6b74d38 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.817053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172e070-4abb-40e8-b886-5854d6b74d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:57.817353 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172e070-4abb-40e8-b886-5854d6b74d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:57.818753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172e070-4abb-40e8-b886-5854d6b74d38 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:57.832857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 391/782] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:57.833684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172e070-4abb-40e8-b886-5854d6b74d38 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:57.864431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04527067-5737-4c03-abd3-e3728e04176d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:57.906310 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b1891-9e2b-451d-8811-67a0a935ea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:57.908774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b1891-9e2b-451d-8811-67a0a935ea31 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.909258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b1891-9e2b-451d-8811-67a0a935ea31 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.909701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b1891-9e2b-451d-8811-67a0a935ea31 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.910559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b1891-9e2b-451d-8811-67a0a935ea31 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:57.912131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b1891-9e2b-451d-8811-67a0a935ea31 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a32b1891-9e2b-451d-8811-67a0a935ea31 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:57.928892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:57.929824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 03:04:57.930752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:57.931539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 392/783] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Jun 28 03:04:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:57.932414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b1891-9e2b-451d-8811-67a0a935ea31 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:57.945093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172e070-4abb-40e8-b886-5854d6b74d38 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:57.959515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:57.983432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6bed3-15f9-415c-a2e0-227d80a6da65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:57.984376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6bed3-15f9-415c-a2e0-227d80a6da65 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:57.984376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6bed3-15f9-415c-a2e0-227d80a6da65 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:57.984662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6bed3-15f9-415c-a2e0-227d80a6da65 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:57.985494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6bed3-15f9-415c-a2e0-227d80a6da65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:57.986918 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6bed3-15f9-415c-a2e0-227d80a6da65 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:58.002330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 392/784] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Jun 28 03:04:57 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:58.002330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6bed3-15f9-415c-a2e0-227d80a6da65 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:58.062389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b1891-9e2b-451d-8811-67a0a935ea31 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:58.080274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:58.103145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c9a06-ba1a-4c86-851b-babba152c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:58.103966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9a06-ba1a-4c86-851b-babba152c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:58.104240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9a06-ba1a-4c86-851b-babba152c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:58.104509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9a06-ba1a-4c86-851b-babba152c7d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:58.117431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c9a06-ba1a-4c86-851b-babba152c7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-850c9a06-ba1a-4c86-851b-babba152c7d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:04:58.125443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:58.126718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:58.127579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 393/785] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:58.128288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c9a06-ba1a-4c86-851b-babba152c7d7 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:58.153213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6bed3-15f9-415c-a2e0-227d80a6da65 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:58.199618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fed85d-6ea4-49c0-a5e4-02498729a88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:58.200745 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fed85d-6ea4-49c0-a5e4-02498729a88a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:58.201030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fed85d-6ea4-49c0-a5e4-02498729a88a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:58.201302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fed85d-6ea4-49c0-a5e4-02498729a88a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:58.210665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fed85d-6ea4-49c0-a5e4-02498729a88a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:58.212130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fed85d-6ea4-49c0-a5e4-02498729a88a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-84fed85d-6ea4-49c0-a5e4-02498729a88a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:58.228807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:58.229811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:58.230803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:58.230803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:58.230803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:58.230803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:58.230803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:58.230803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:58.230803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:58.230803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:58.230803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:04:58.230803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:58.232509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:58.232932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 393/786] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Jun 28 03:04:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:58.233141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fed85d-6ea4-49c0-a5e4-02498729a88a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:58.256039 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c9a06-ba1a-4c86-851b-babba152c7d7 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:58.302741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd0c83-6f68-40b9-95e7-307ee7b69349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:58.303625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd0c83-6f68-40b9-95e7-307ee7b69349 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:58.304466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd0c83-6f68-40b9-95e7-307ee7b69349 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:58.304764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd0c83-6f68-40b9-95e7-307ee7b69349 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:58.305678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd0c83-6f68-40b9-95e7-307ee7b69349 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:58.306122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd0c83-6f68-40b9-95e7-307ee7b69349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:58.307820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd0c83-6f68-40b9-95e7-307ee7b69349 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:58.314487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 394/787] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Jun 28 03:04:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:58.319188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd0c83-6f68-40b9-95e7-307ee7b69349 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:58.343885 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fed85d-6ea4-49c0-a5e4-02498729a88a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:58.354103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:58.385827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3c82f-1a25-4eff-aac3-71c629978077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:58.387270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3c82f-1a25-4eff-aac3-71c629978077 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:58.387707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3c82f-1a25-4eff-aac3-71c629978077 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:58.388148 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3c82f-1a25-4eff-aac3-71c629978077 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:58.389092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3c82f-1a25-4eff-aac3-71c629978077 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:58.389554 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3c82f-1a25-4eff-aac3-71c629978077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:58.391590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3c82f-1a25-4eff-aac3-71c629978077 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:58.404293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 394/788] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:04:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:58.405653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3c82f-1a25-4eff-aac3-71c629978077 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:58.439594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd0c83-6f68-40b9-95e7-307ee7b69349 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:58.476590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9e743-7be3-4bdf-a462-df132208a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:58.477709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9e743-7be3-4bdf-a462-df132208a81a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:58.478083 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9e743-7be3-4bdf-a462-df132208a81a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:58.478489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9e743-7be3-4bdf-a462-df132208a81a None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:58.479726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9e743-7be3-4bdf-a462-df132208a81a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:58.479726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9e743-7be3-4bdf-a462-df132208a81a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:58.481276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9e743-7be3-4bdf-a462-df132208a81a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:58.508477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 395/789] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Jun 28 03:04:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:58.509535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9e743-7be3-4bdf-a462-df132208a81a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:58.519428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:58.555895 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3c82f-1a25-4eff-aac3-71c629978077 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:58.591382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477b97d-0d64-46cc-abb8-45109529dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:58.592159 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477b97d-0d64-46cc-abb8-45109529dffb None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:58.592531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477b97d-0d64-46cc-abb8-45109529dffb None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:58.592914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477b97d-0d64-46cc-abb8-45109529dffb None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:58.593719 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477b97d-0d64-46cc-abb8-45109529dffb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:58.594202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477b97d-0d64-46cc-abb8-45109529dffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:58.595821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477b97d-0d64-46cc-abb8-45109529dffb None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:58.601992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 395/790] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Jun 28 03:04:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:58.603018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477b97d-0d64-46cc-abb8-45109529dffb None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:58.636664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9e743-7be3-4bdf-a462-df132208a81a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:58.639386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:58.688239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661d5bd-ac00-4274-a660-89c65ad67ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:58.689148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d5bd-ac00-4274-a660-89c65ad67ccd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:58.690003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d5bd-ac00-4274-a660-89c65ad67ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:58.690313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d5bd-ac00-4274-a660-89c65ad67ccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:58.704731 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661d5bd-ac00-4274-a660-89c65ad67ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:58.706755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661d5bd-ac00-4274-a660-89c65ad67ccd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:58.716181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477b97d-0d64-46cc-abb8-45109529dffb None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-4661d5bd-ac00-4274-a660-89c65ad67ccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:58.731247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:58.732149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:58.733025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:58.733025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:58.733025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:58.733025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:58.733025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 396/791] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:58.733717 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661d5bd-ac00-4274-a660-89c65ad67ccd None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:58.758032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0b4f9-f187-4199-8b88-96e6d77d337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:58.759265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0b4f9-f187-4199-8b88-96e6d77d337e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:58.759737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0b4f9-f187-4199-8b88-96e6d77d337e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:58.760194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0b4f9-f187-4199-8b88-96e6d77d337e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:58.773271 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0b4f9-f187-4199-8b88-96e6d77d337e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:58.775200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0b4f9-f187-4199-8b88-96e6d77d337e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-2be0b4f9-f187-4199-8b88-96e6d77d337e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:58.795447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:58.796386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:58.797309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:58.797309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:58.797309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:58.797309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:58.800346 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 396/792] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:58.801419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0b4f9-f187-4199-8b88-96e6d77d337e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:58.809865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:58.857543 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661d5bd-ac00-4274-a660-89c65ad67ccd None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:58.899765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8da705-9bf8-46b0-97d4-4a9fa6c1c2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:58.900813 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da705-9bf8-46b0-97d4-4a9fa6c1c2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:58.901285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da705-9bf8-46b0-97d4-4a9fa6c1c2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:58.901771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8da705-9bf8-46b0-97d4-4a9fa6c1c2a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:58.902793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8da705-9bf8-46b0-97d4-4a9fa6c1c2a2 None admin] RBAC: Adding query filter params (interface=public, service_id=117042714a28459c8328692975b65cd3, region_id=RegionOne) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:58.903295 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8da705-9bf8-46b0-97d4-4a9fa6c1c2a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:58.904879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8da705-9bf8-46b0-97d4-4a9fa6c1c2a2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:58.914133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:58.915598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 397/793] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Jun 28 03:04:58 2022] GET /identity/v3/endpoints?service_id=117042714a28459c8328692975b65cd3&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:58.923707 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8da705-9bf8-46b0-97d4-4a9fa6c1c2a2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:58.938379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0b4f9-f187-4199-8b88-96e6d77d337e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:58.991624 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53cb6-a903-4d35-8d14-d0b0922eb48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:58.992688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53cb6-a903-4d35-8d14-d0b0922eb48c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:58.993188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53cb6-a903-4d35-8d14-d0b0922eb48c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:58.993647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53cb6-a903-4d35-8d14-d0b0922eb48c None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:58.994779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53cb6-a903-4d35-8d14-d0b0922eb48c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:58.995273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53cb6-a903-4d35-8d14-d0b0922eb48c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:58.996837 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53cb6-a903-4d35-8d14-d0b0922eb48c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:59.012253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 397/794] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:59.013441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53cb6-a903-4d35-8d14-d0b0922eb48c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:59.070233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8da705-9bf8-46b0-97d4-4a9fa6c1c2a2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:59.093868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:59.107444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015dfb9-1c0d-43f4-8084-8af925321a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:59.108568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015dfb9-1c0d-43f4-8084-8af925321a8d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:59.109053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015dfb9-1c0d-43f4-8084-8af925321a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:59.109567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015dfb9-1c0d-43f4-8084-8af925321a8d None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:59.110662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015dfb9-1c0d-43f4-8084-8af925321a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:59.111170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015dfb9-1c0d-43f4-8084-8af925321a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:59.112774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015dfb9-1c0d-43f4-8084-8af925321a8d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:59.132374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 398/795] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:59.133563 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015dfb9-1c0d-43f4-8084-8af925321a8d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:59.144352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53cb6-a903-4d35-8d14-d0b0922eb48c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:59.180920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec43246-5d47-4ead-a128-3aab7b135075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:59.182015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec43246-5d47-4ead-a128-3aab7b135075 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:59.182550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec43246-5d47-4ead-a128-3aab7b135075 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:59.183044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec43246-5d47-4ead-a128-3aab7b135075 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:59.183953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec43246-5d47-4ead-a128-3aab7b135075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:59.185679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec43246-5d47-4ead-a128-3aab7b135075 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:59.192512 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 398/796] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Jun 28 03:04:59 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:59.193887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec43246-5d47-4ead-a128-3aab7b135075 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:59.213638 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:59.324091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec43246-5d47-4ead-a128-3aab7b135075 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:59.343794 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015dfb9-1c0d-43f4-8084-8af925321a8d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:59.366605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eede1-7457-400f-ad27-f18f2ad9d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:59.367429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eede1-7457-400f-ad27-f18f2ad9d033 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:59.367714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eede1-7457-400f-ad27-f18f2ad9d033 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:59.367988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eede1-7457-400f-ad27-f18f2ad9d033 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:59.376193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eede1-7457-400f-ad27-f18f2ad9d033 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:59.377851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eede1-7457-400f-ad27-f18f2ad9d033 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-4b2eede1-7457-400f-ad27-f18f2ad9d033 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:04:59.393778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:59.394758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:59.395681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:04:59.395681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:04:59.395681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:04:59.395681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:04:59.395681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:04:59.395681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:04:59.395681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:04:59.395681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:04:59.395681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 399/797] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:59.403510 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eede1-7457-400f-ad27-f18f2ad9d033 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:59.424198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98556c06-defb-45d4-8076-3b3209521374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:59.425473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98556c06-defb-45d4-8076-3b3209521374 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:59.426006 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98556c06-defb-45d4-8076-3b3209521374 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:59.426502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98556c06-defb-45d4-8076-3b3209521374 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:59.440631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98556c06-defb-45d4-8076-3b3209521374 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:59.447059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98556c06-defb-45d4-8076-3b3209521374 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-98556c06-defb-45d4-8076-3b3209521374 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:04:59.470628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:59.471728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:59.472676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:59.472676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:59.472676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:04:59.472676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:04:59.472676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:04:59.472676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:04:59.472676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:04:59.472676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:04:59.472676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:04:59.472676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:59.475355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 399/798] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:04:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:59.484961 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98556c06-defb-45d4-8076-3b3209521374 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:59.517803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:59.553801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:59.555253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eede1-7457-400f-ad27-f18f2ad9d033 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:59.611370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd2978-9389-4ff0-a678-73392c17b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:59.612140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd2978-9389-4ff0-a678-73392c17b621 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:59.612331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd2978-9389-4ff0-a678-73392c17b621 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:59.612608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd2978-9389-4ff0-a678-73392c17b621 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:59.613401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd2978-9389-4ff0-a678-73392c17b621 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:59.613708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd2978-9389-4ff0-a678-73392c17b621 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:59.615575 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd2978-9389-4ff0-a678-73392c17b621 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:59.658314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98556c06-defb-45d4-8076-3b3209521374 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:59.727259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc421b75-ffe1-42b0-a895-a825c79f6dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:59.727956 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc421b75-ffe1-42b0-a895-a825c79f6dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:59.728238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc421b75-ffe1-42b0-a895-a825c79f6dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:59.728514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc421b75-ffe1-42b0-a895-a825c79f6dc1 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:59.729369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc421b75-ffe1-42b0-a895-a825c79f6dc1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:04:59.729679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc421b75-ffe1-42b0-a895-a825c79f6dc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:59.731160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc421b75-ffe1-42b0-a895-a825c79f6dc1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:59.767833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 400/799] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Jun 28 03:04:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:59.769444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da08af3-c15b-419a-9f86-d3d9f99336ad None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:59.769743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da08af3-c15b-419a-9f86-d3d9f99336ad None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:59.770023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da08af3-c15b-419a-9f86-d3d9f99336ad None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:59.775433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 401/800] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:04:59.775433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da08af3-c15b-419a-9f86-d3d9f99336ad None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:59.846478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 400/801] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:04:59.847931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3699d-e67f-42c7-a739-4866837a2fa4 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:59.848178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3699d-e67f-42c7-a739-4866837a2fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:59.848452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3699d-e67f-42c7-a739-4866837a2fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:59.871005 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-02a3699d-e67f-42c7-a739-4866837a2fa4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:04:59.872565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-02a3699d-e67f-42c7-a739-4866837a2fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:04:59.887336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:04:59.893534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da08af3-c15b-419a-9f86-d3d9f99336ad None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:04:59.937602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e521fb5-b029-47eb-81b1-24e54a239156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:04:59.938374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e521fb5-b029-47eb-81b1-24e54a239156 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:04:59.938659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e521fb5-b029-47eb-81b1-24e54a239156 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:04:59.938984 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e521fb5-b029-47eb-81b1-24e54a239156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:04:59.950183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e521fb5-b029-47eb-81b1-24e54a239156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:04:59.951695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e521fb5-b029-47eb-81b1-24e54a239156 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:04:59.962652 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 401/802] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:04:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:04:59.963909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3699d-e67f-42c7-a739-4866837a2fa4 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-5e521fb5-b029-47eb-81b1-24e54a239156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:04:59.970725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:04:59.971600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:04:59.972481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:04:59.972481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:04:59.972481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:04:59.972481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:04:59.972481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 402/803] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:04:59.977494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e521fb5-b029-47eb-81b1-24e54a239156 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:00.034689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:00.085762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3699d-e67f-42c7-a739-4866837a2fa4 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:00.107080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e521fb5-b029-47eb-81b1-24e54a239156 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:00.121369 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cb31d-83d3-4865-b3bf-f82fabb9bbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:00.122211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cb31d-83d3-4865-b3bf-f82fabb9bbfa None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:00.122517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cb31d-83d3-4865-b3bf-f82fabb9bbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:00.122786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cb31d-83d3-4865-b3bf-f82fabb9bbfa None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/a7d95e643b984955a20e48f71b204502/roles/a26fe2ec418e475fb65528485c92428a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:00.138571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cb31d-83d3-4865-b3bf-f82fabb9bbfa None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=a7d95e643b984955a20e48f71b204502, role_id=a26fe2ec418e475fb65528485c92428a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:00.139878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cb31d-83d3-4865-b3bf-f82fabb9bbfa None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:00.147578 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890869a-da6f-4173-bf93-3b8b2b9f9d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:00.148629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890869a-da6f-4173-bf93-3b8b2b9f9d1d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:00.149161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890869a-da6f-4173-bf93-3b8b2b9f9d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:00.149702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890869a-da6f-4173-bf93-3b8b2b9f9d1d None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:00.150680 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890869a-da6f-4173-bf93-3b8b2b9f9d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:00.151175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890869a-da6f-4173-bf93-3b8b2b9f9d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:00.152907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890869a-da6f-4173-bf93-3b8b2b9f9d1d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:00.162320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 402/804] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:04:59 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/a7d95e643b984955a20e48f71b204502/roles/a26fe2ec418e475fb65528485c92428a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:05:00.162320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cb31d-83d3-4865-b3bf-f82fabb9bbfa None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:00.180424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 403/805] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:00.188422 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890869a-da6f-4173-bf93-3b8b2b9f9d1d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:00.210159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:00.284564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cb31d-83d3-4865-b3bf-f82fabb9bbfa None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:00.296599 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:00.315216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890869a-da6f-4173-bf93-3b8b2b9f9d1d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:00.323694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbd40b-6491-4c20-85d1-ddf5c6227bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:00.324807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbd40b-6491-4c20-85d1-ddf5c6227bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:00.324920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbd40b-6491-4c20-85d1-ddf5c6227bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:00.325157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbd40b-6491-4c20-85d1-ddf5c6227bc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:00.337338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbd40b-6491-4c20-85d1-ddf5c6227bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-9abbd40b-6491-4c20-85d1-ddf5c6227bc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:00.346028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:00.347012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:00.347850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 403/806] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:00.349047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53c2cc-5a5e-40b0-825f-920f5761f553 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:00.349320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53c2cc-5a5e-40b0-825f-920f5761f553 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:00.349602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53c2cc-5a5e-40b0-825f-920f5761f553 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:00.351173 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 404/807] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:00.355282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53c2cc-5a5e-40b0-825f-920f5761f553 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:00.360842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d19a6-a36c-47dc-a525-31051b6c43d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:00.362329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d19a6-a36c-47dc-a525-31051b6c43d6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:00.362704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d19a6-a36c-47dc-a525-31051b6c43d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:00.363045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d19a6-a36c-47dc-a525-31051b6c43d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:00.370870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d19a6-a36c-47dc-a525-31051b6c43d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:00.372399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d19a6-a36c-47dc-a525-31051b6c43d6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-5b7d19a6-a36c-47dc-a525-31051b6c43d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:05:00.393435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:00.394416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:00.395338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:05:00.395338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:05:00.395338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:05:00.395338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:05:00.395338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:05:00.395338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:05:00.395338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:00.395338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:00.395761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 404/808] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:00.397396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0652cb2-6cc7-4c27-ba59-f68a5563935f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:00.402995 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0652cb2-6cc7-4c27-ba59-f68a5563935f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:00.403295 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0652cb2-6cc7-4c27-ba59-f68a5563935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:00.424603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a0652cb2-6cc7-4c27-ba59-f68a5563935f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:00.425967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a0652cb2-6cc7-4c27-ba59-f68a5563935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:00.467010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53c2cc-5a5e-40b0-825f-920f5761f553 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:00.503942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28675736-e84e-4204-b864-c9fe79df82ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:00.503942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28675736-e84e-4204-b864-c9fe79df82ef None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:00.504734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28675736-e84e-4204-b864-c9fe79df82ef None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:00.505147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28675736-e84e-4204-b864-c9fe79df82ef None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:00.506184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28675736-e84e-4204-b864-c9fe79df82ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:00.506597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28675736-e84e-4204-b864-c9fe79df82ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:00.508222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28675736-e84e-4204-b864-c9fe79df82ef None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:00.514425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 405/809] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:00.515427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0652cb2-6cc7-4c27-ba59-f68a5563935f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:00.518221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:00.519497 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 405/810] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:05:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:00.523444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28675736-e84e-4204-b864-c9fe79df82ef None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:00.571495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:00.638892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0652cb2-6cc7-4c27-ba59-f68a5563935f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:00.664205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28675736-e84e-4204-b864-c9fe79df82ef None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:00.673479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c17c3c-1d16-4785-9d1f-d484cdf5d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:00.674161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c17c3c-1d16-4785-9d1f-d484cdf5d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:00.674473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c17c3c-1d16-4785-9d1f-d484cdf5d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:00.674747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c17c3c-1d16-4785-9d1f-d484cdf5d6c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:00.675542 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c17c3c-1d16-4785-9d1f-d484cdf5d6c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:00.675849 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c17c3c-1d16-4785-9d1f-d484cdf5d6c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:00.677305 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c17c3c-1d16-4785-9d1f-d484cdf5d6c9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:00.690334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 406/811] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:00.691612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c17c3c-1d16-4785-9d1f-d484cdf5d6c9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:00.707668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d8538-a14d-4894-801c-8d27966665c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:00.708484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d8538-a14d-4894-801c-8d27966665c9 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:00.708773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d8538-a14d-4894-801c-8d27966665c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:00.709047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d8538-a14d-4894-801c-8d27966665c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:00.720713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d8538-a14d-4894-801c-8d27966665c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:00.722100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d8538-a14d-4894-801c-8d27966665c9 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-e85d8538-a14d-4894-801c-8d27966665c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:00.740082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:00.741166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:00.742264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:00.742264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:00.742264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:00.742264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:00.742264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 406/812] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:00.742643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d8538-a14d-4894-801c-8d27966665c9 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:00.782716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:00.828210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c17c3c-1d16-4785-9d1f-d484cdf5d6c9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:00.830862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:00.850829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d8538-a14d-4894-801c-8d27966665c9 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:00.871973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703ab2-2616-486f-8a90-8d3c18e54e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:00.872796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703ab2-2616-486f-8a90-8d3c18e54e35 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:00.873077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703ab2-2616-486f-8a90-8d3c18e54e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:00.873352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703ab2-2616-486f-8a90-8d3c18e54e35 None admin] PATH_INFO: `/v3/services/network` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:00.874110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703ab2-2616-486f-8a90-8d3c18e54e35 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:00.875885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703ab2-2616-486f-8a90-8d3c18e54e35 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:00.885703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416dc4a-2179-43ba-8326-b1ceabb54532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:00.886640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416dc4a-2179-43ba-8326-b1ceabb54532 None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:00.886921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416dc4a-2179-43ba-8326-b1ceabb54532 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:00.887195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416dc4a-2179-43ba-8326-b1ceabb54532 None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/9a40d290f0e147b9b62cf3eedf399e6c/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-97703ab2-2616-486f-8a90-8d3c18e54e35 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:00.888669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:00.889613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 03:05:00.890480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:00.892113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416dc4a-2179-43ba-8326-b1ceabb54532 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=9a40d290f0e147b9b62cf3eedf399e6c, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:00.892259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 407/813] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:00 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:00.892396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416dc4a-2179-43ba-8326-b1ceabb54532 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:00.892544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703ab2-2616-486f-8a90-8d3c18e54e35 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:00.911905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 407/814] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:05:00 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/9a40d290f0e147b9b62cf3eedf399e6c/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:05:00.912741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416dc4a-2179-43ba-8326-b1ceabb54532 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:01.025230 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703ab2-2616-486f-8a90-8d3c18e54e35 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:01.079081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:01.101996 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f3ae9-1595-4912-83fb-a44e045e4073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:01.102725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f3ae9-1595-4912-83fb-a44e045e4073 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:01.103009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f3ae9-1595-4912-83fb-a44e045e4073 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:01.103282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f3ae9-1595-4912-83fb-a44e045e4073 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:01.104034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f3ae9-1595-4912-83fb-a44e045e4073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:01.104345 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f3ae9-1595-4912-83fb-a44e045e4073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:01.109101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f3ae9-1595-4912-83fb-a44e045e4073 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:01.137479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 408/815] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:01.143816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f3ae9-1595-4912-83fb-a44e045e4073 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:01.163955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416dc4a-2179-43ba-8326-b1ceabb54532 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:01.199783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd807bf-be41-4a84-9a62-15d8d5cceabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:01.200458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd807bf-be41-4a84-9a62-15d8d5cceabc None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:01.200743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd807bf-be41-4a84-9a62-15d8d5cceabc None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:01.201017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd807bf-be41-4a84-9a62-15d8d5cceabc None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:01.201786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd807bf-be41-4a84-9a62-15d8d5cceabc None admin] RBAC: Adding query filter params (name=network) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:01.202097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd807bf-be41-4a84-9a62-15d8d5cceabc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:01.203702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd807bf-be41-4a84-9a62-15d8d5cceabc None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:01.208794 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 408/816] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:05:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:01.214466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd807bf-be41-4a84-9a62-15d8d5cceabc None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:01.226457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:01.260186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f3ae9-1595-4912-83fb-a44e045e4073 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:01.297111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84ae7-9ad9-4fda-81ff-afaf19c0afae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:01.298415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84ae7-9ad9-4fda-81ff-afaf19c0afae None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:01.298933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84ae7-9ad9-4fda-81ff-afaf19c0afae None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:01.299424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84ae7-9ad9-4fda-81ff-afaf19c0afae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:01.307843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa84ae7-9ad9-4fda-81ff-afaf19c0afae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:01.309687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa84ae7-9ad9-4fda-81ff-afaf19c0afae None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-4aa84ae7-9ad9-4fda-81ff-afaf19c0afae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:05:01.325497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:01.326520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:01.327468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:01.327468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:01.327468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:05:01.327468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:05:01.327468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:05:01.327468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:05:01.327468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:05:01.327468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:05:01.327468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:05:01.327468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:01.330241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 409/817] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Jun 28 03:05:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:01.336229 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84ae7-9ad9-4fda-81ff-afaf19c0afae None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:01.353067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd807bf-be41-4a84-9a62-15d8d5cceabc None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:01.394679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:01.423123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead971b4-9390-40f9-a250-aca69ae4a458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:01.423724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead971b4-9390-40f9-a250-aca69ae4a458 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:01.424011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead971b4-9390-40f9-a250-aca69ae4a458 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:01.424290 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead971b4-9390-40f9-a250-aca69ae4a458 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:01.425020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead971b4-9390-40f9-a250-aca69ae4a458 None admin] RBAC: Adding query filter params (type=network) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:01.425327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead971b4-9390-40f9-a250-aca69ae4a458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:01.426749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead971b4-9390-40f9-a250-aca69ae4a458 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:01.432473 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 409/818] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:05:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:01.437960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead971b4-9390-40f9-a250-aca69ae4a458 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:01.448057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84ae7-9ad9-4fda-81ff-afaf19c0afae None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:01.486333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3866462-b2f5-4213-b3c2-d8499d54a1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:01.487590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866462-b2f5-4213-b3c2-d8499d54a1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:01.488110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866462-b2f5-4213-b3c2-d8499d54a1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:01.488616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866462-b2f5-4213-b3c2-d8499d54a1f3 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:01.490004 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3866462-b2f5-4213-b3c2-d8499d54a1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:01.490573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3866462-b2f5-4213-b3c2-d8499d54a1f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:01.492311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3866462-b2f5-4213-b3c2-d8499d54a1f3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:01.516950 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 410/819] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Jun 28 03:05:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:01.523175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:01.524678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3866462-b2f5-4213-b3c2-d8499d54a1f3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:01.542633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead971b4-9390-40f9-a250-aca69ae4a458 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:01.581929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897bf64-1772-40b8-b284-3db6567c5634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:01.582277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897bf64-1772-40b8-b284-3db6567c5634 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:01.583206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897bf64-1772-40b8-b284-3db6567c5634 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:01.583492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897bf64-1772-40b8-b284-3db6567c5634 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:01.584559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897bf64-1772-40b8-b284-3db6567c5634 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:01.586316 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897bf64-1772-40b8-b284-3db6567c5634 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:01.636330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 410/820] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Jun 28 03:05:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:05:01.638098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90d1e9-d3de-4666-bc26-3693b2ea5760 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:01.638623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90d1e9-d3de-4666-bc26-3693b2ea5760 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:01.639176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90d1e9-d3de-4666-bc26-3693b2ea5760 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:01.646834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 411/821] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:01.648727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab167217-3494-40ed-ab02-8f4a8aafd962 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:01.649251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab167217-3494-40ed-ab02-8f4a8aafd962 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:01.649803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab167217-3494-40ed-ab02-8f4a8aafd962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:01.670459 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-ab167217-3494-40ed-ab02-8f4a8aafd962 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:01.673445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ab167217-3494-40ed-ab02-8f4a8aafd962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:01.716215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3866462-b2f5-4213-b3c2-d8499d54a1f3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:01.719208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:01.780999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 412/822] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:01.805241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448c402-b4d2-4728-8214-1be05eae6e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:01.805939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448c402-b4d2-4728-8214-1be05eae6e17 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:01.806220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448c402-b4d2-4728-8214-1be05eae6e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:01.806517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448c402-b4d2-4728-8214-1be05eae6e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:01.808570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab167217-3494-40ed-ab02-8f4a8aafd962 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:01.894731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:01.922057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448c402-b4d2-4728-8214-1be05eae6e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:01.924606 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448c402-b4d2-4728-8214-1be05eae6e17 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:01.959921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab167217-3494-40ed-ab02-8f4a8aafd962 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:02.002793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9b049-d6c4-45a6-a9d7-cd9713f0da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:02.004429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9b049-d6c4-45a6-a9d7-cd9713f0da2a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.005222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9b049-d6c4-45a6-a9d7-cd9713f0da2a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.005965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9b049-d6c4-45a6-a9d7-cd9713f0da2a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.007659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9b049-d6c4-45a6-a9d7-cd9713f0da2a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:02.009378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9b049-d6c4-45a6-a9d7-cd9713f0da2a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-99e9b049-d6c4-45a6-a9d7-cd9713f0da2a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:02.025383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:02.026407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 03:05:02.027240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:02.030409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 413/823] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Jun 28 03:05:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:02.036665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9b049-d6c4-45a6-a9d7-cd9713f0da2a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:02.040501 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 411/824] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:05:02.059993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448c402-b4d2-4728-8214-1be05eae6e17 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:02.063938 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:02.157217 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9b049-d6c4-45a6-a9d7-cd9713f0da2a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:02.170385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448c402-b4d2-4728-8214-1be05eae6e17 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:02.175578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:02.194351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8ab25-297f-40b4-90a1-f59caeeeb9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:02.195397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8ab25-297f-40b4-90a1-f59caeeeb9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.195877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8ab25-297f-40b4-90a1-f59caeeeb9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.196360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8ab25-297f-40b4-90a1-f59caeeeb9e7 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.197265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8ab25-297f-40b4-90a1-f59caeeeb9e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:02.197763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8ab25-297f-40b4-90a1-f59caeeeb9e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:02.199413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8ab25-297f-40b4-90a1-f59caeeeb9e7 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:02.205098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 414/825] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Jun 28 03:05:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:02.209634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799276a-b357-4bbc-8adf-d7c2a5ec2ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:02.209634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799276a-b357-4bbc-8adf-d7c2a5ec2ffb None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.209634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799276a-b357-4bbc-8adf-d7c2a5ec2ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.209634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799276a-b357-4bbc-8adf-d7c2a5ec2ffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.211032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8ab25-297f-40b4-90a1-f59caeeeb9e7 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:02.217943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799276a-b357-4bbc-8adf-d7c2a5ec2ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:02.219500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799276a-b357-4bbc-8adf-d7c2a5ec2ffb None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-6799276a-b357-4bbc-8adf-d7c2a5ec2ffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:02.238625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:02.239540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:02.240789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:02.240789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:02.240789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:02.240789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:02.240789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 412/826] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:02.246156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799276a-b357-4bbc-8adf-d7c2a5ec2ffb None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:02.314732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:02.317461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8ab25-297f-40b4-90a1-f59caeeeb9e7 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:02.356183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f330f-323f-433f-b749-06db95effbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:02.356870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f330f-323f-433f-b749-06db95effbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.357135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f330f-323f-433f-b749-06db95effbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.362314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f330f-323f-433f-b749-06db95effbf9 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.362481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799276a-b357-4bbc-8adf-d7c2a5ec2ffb None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:02.362573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f330f-323f-433f-b749-06db95effbf9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:02.362573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f330f-323f-433f-b749-06db95effbf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:02.362573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f330f-323f-433f-b749-06db95effbf9 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:02.366139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 415/827] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Jun 28 03:05:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:02.372846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f330f-323f-433f-b749-06db95effbf9 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:02.397728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1818c6-685c-423f-b67d-6580084e8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:02.398452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1818c6-685c-423f-b67d-6580084e8a92 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.398737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1818c6-685c-423f-b67d-6580084e8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.399065 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1818c6-685c-423f-b67d-6580084e8a92 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.400631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1818c6-685c-423f-b67d-6580084e8a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:02.400948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1818c6-685c-423f-b67d-6580084e8a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:02.402367 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1818c6-685c-423f-b67d-6580084e8a92 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:02.422651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 413/828] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:02.423580 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1818c6-685c-423f-b67d-6580084e8a92 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:02.434947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:02.491515 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f330f-323f-433f-b749-06db95effbf9 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:02.527275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1682-fd0d-42c5-80cf-966b5c62b147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:02.528265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1682-fd0d-42c5-80cf-966b5c62b147 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.528553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1682-fd0d-42c5-80cf-966b5c62b147 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.528831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1682-fd0d-42c5-80cf-966b5c62b147 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.529580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df1682-fd0d-42c5-80cf-966b5c62b147 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:02.530991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df1682-fd0d-42c5-80cf-966b5c62b147 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:02.534195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1818c6-685c-423f-b67d-6580084e8a92 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:02.551444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 416/829] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Jun 28 03:05:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:05:02.552818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228a245-57cd-4a72-addf-95c89802a190 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.553108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228a245-57cd-4a72-addf-95c89802a190 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.553377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228a245-57cd-4a72-addf-95c89802a190 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.559110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 417/830] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:02.559527 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:02.560572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265d15-992b-432a-b6a4-77a47fceb484 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.560869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265d15-992b-432a-b6a4-77a47fceb484 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.561204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70265d15-992b-432a-b6a4-77a47fceb484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.580074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-70265d15-992b-432a-b6a4-77a47fceb484 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:02.581343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-70265d15-992b-432a-b6a4-77a47fceb484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:02.595433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbab207-c0be-4d30-94e7-14ae77cee679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:02.596708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab207-c0be-4d30-94e7-14ae77cee679 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.597195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab207-c0be-4d30-94e7-14ae77cee679 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.597825 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab207-c0be-4d30-94e7-14ae77cee679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.606505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbab207-c0be-4d30-94e7-14ae77cee679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:02.608140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbab207-c0be-4d30-94e7-14ae77cee679 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-fdbab207-c0be-4d30-94e7-14ae77cee679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:05:02.626494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:02.627511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:02.628473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:05:02.628473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:05:02.628473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:05:02.628473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:05:02.628473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:05:02.628473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:05:02.628473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:02.628473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:02.628473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 414/831] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:02.633470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbab207-c0be-4d30-94e7-14ae77cee679 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:02.670676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 418/832] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:02.696204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70265d15-992b-432a-b6a4-77a47fceb484 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:02.747079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:02.774093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbab207-c0be-4d30-94e7-14ae77cee679 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:02.821530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ee57-4b76-4ebf-a20c-996cf18d5f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:02.822490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ee57-4b76-4ebf-a20c-996cf18d5f1c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.822810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ee57-4b76-4ebf-a20c-996cf18d5f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.823471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ee57-4b76-4ebf-a20c-996cf18d5f1c None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.824271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453ee57-4b76-4ebf-a20c-996cf18d5f1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:02.824583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453ee57-4b76-4ebf-a20c-996cf18d5f1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:02.826202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453ee57-4b76-4ebf-a20c-996cf18d5f1c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:02.830747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70265d15-992b-432a-b6a4-77a47fceb484 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:02.839784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 415/833] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:02.845672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ee57-4b76-4ebf-a20c-996cf18d5f1c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:02.868744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e43608-df0c-4017-82d9-f251b33db532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:02.869630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e43608-df0c-4017-82d9-f251b33db532 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.869914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e43608-df0c-4017-82d9-f251b33db532 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.870186 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e43608-df0c-4017-82d9-f251b33db532 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.878226 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:02.883713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e43608-df0c-4017-82d9-f251b33db532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-e8e43608-df0c-4017-82d9-f251b33db532 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:02.894437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:02.895606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:02.896667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 419/834] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:05:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:02.902265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e43608-df0c-4017-82d9-f251b33db532 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:02.952190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ee57-4b76-4ebf-a20c-996cf18d5f1c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:02.987843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc66de-99b0-489b-8eee-7a806a9775b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:02.988621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc66de-99b0-489b-8eee-7a806a9775b1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:02.988975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc66de-99b0-489b-8eee-7a806a9775b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:02.989318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc66de-99b0-489b-8eee-7a806a9775b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:02.990667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc66de-99b0-489b-8eee-7a806a9775b1 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=b1868e9d8b004c4fb781e532c775428e) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:02.991057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc66de-99b0-489b-8eee-7a806a9775b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:02.992612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc66de-99b0-489b-8eee-7a806a9775b1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:03.004565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:03.006475 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 416/835] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:02 2022] GET /identity/v3/role_assignments?user.id=b1868e9d8b004c4fb781e532c775428e&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:03.019081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e43608-df0c-4017-82d9-f251b33db532 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:03.062908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7f4d6-a064-4bac-a161-e71ab3dbe32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:03.063645 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7f4d6-a064-4bac-a161-e71ab3dbe32e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:03.063923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7f4d6-a064-4bac-a161-e71ab3dbe32e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:03.064194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7f4d6-a064-4bac-a161-e71ab3dbe32e None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:03.065071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7f4d6-a064-4bac-a161-e71ab3dbe32e None admin] RBAC: Adding query filter params (name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:03.065447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7f4d6-a064-4bac-a161-e71ab3dbe32e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:03.066957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7f4d6-a064-4bac-a161-e71ab3dbe32e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:03.077625 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 420/836] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:05:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:03.087500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc66de-99b0-489b-8eee-7a806a9775b1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:03.198573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:03.205695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc66de-99b0-489b-8eee-7a806a9775b1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:03.241984 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b706ba-e023-46a4-8b04-ad73ff7e1cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:03.242847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b706ba-e023-46a4-8b04-ad73ff7e1cee None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:03.243121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b706ba-e023-46a4-8b04-ad73ff7e1cee None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:03.243392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b706ba-e023-46a4-8b04-ad73ff7e1cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:03.255241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b706ba-e023-46a4-8b04-ad73ff7e1cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:03.256788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b706ba-e023-46a4-8b04-ad73ff7e1cee None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d1b706ba-e023-46a4-8b04-ad73ff7e1cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:03.274878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:03.275811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:03.276694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:03.276694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:03.276694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:03.276694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:03.276694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 417/837] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:03.281893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7f4d6-a064-4bac-a161-e71ab3dbe32e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:03.389927 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7f4d6-a064-4bac-a161-e71ab3dbe32e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:03.398309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89a11d-8870-4ce1-b726-382c85d26c55 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:03.399261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89a11d-8870-4ce1-b726-382c85d26c55 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:03.399737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89a11d-8870-4ce1-b726-382c85d26c55 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:03.401578 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 418/838] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:03.407129 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cef39-701c-4877-bcf1-5367f162664d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:03.407452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cef39-701c-4877-bcf1-5367f162664d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:03.407816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cef39-701c-4877-bcf1-5367f162664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:03.425604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f77cef39-701c-4877-bcf1-5367f162664d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:03.427337 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f77cef39-701c-4877-bcf1-5367f162664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:03.428342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb766e38-0353-4cb3-874e-0c18452cfc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:03.429012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766e38-0353-4cb3-874e-0c18452cfc93 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:03.429287 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766e38-0353-4cb3-874e-0c18452cfc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:03.429556 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766e38-0353-4cb3-874e-0c18452cfc93 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:03.430275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb766e38-0353-4cb3-874e-0c18452cfc93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:03.430775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb766e38-0353-4cb3-874e-0c18452cfc93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:03.432979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb766e38-0353-4cb3-874e-0c18452cfc93 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:03.449097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 421/839] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:03.454193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb766e38-0353-4cb3-874e-0c18452cfc93 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:03.506756 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:03.512558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 419/840] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:03.535860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cef39-701c-4877-bcf1-5367f162664d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:03.581792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb766e38-0353-4cb3-874e-0c18452cfc93 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:03.616465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:03.625651 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f6ac5-f29e-4030-aae2-802b5c6adae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:03.627152 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f6ac5-f29e-4030-aae2-802b5c6adae6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:03.627847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f6ac5-f29e-4030-aae2-802b5c6adae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:03.628293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f6ac5-f29e-4030-aae2-802b5c6adae6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:03.638158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f6ac5-f29e-4030-aae2-802b5c6adae6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:03.638320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cef39-701c-4877-bcf1-5367f162664d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:03.640134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f6ac5-f29e-4030-aae2-802b5c6adae6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-b40f6ac5-f29e-4030-aae2-802b5c6adae6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:05:03.660094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:03.661293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:03.662576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:03.662576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:03.662576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:05:03.662576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:05:03.662576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:05:03.662576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:05:03.662576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:05:03.662576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:05:03.662576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:05:03.662576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:03.663628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 422/841] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Jun 28 03:05:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:03.669185 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f6ac5-f29e-4030-aae2-802b5c6adae6 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:03.689204 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa92af9-6056-4f6e-80f8-c6f2c3d3ee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:03.691170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa92af9-6056-4f6e-80f8-c6f2c3d3ee6b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:03.691655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa92af9-6056-4f6e-80f8-c6f2c3d3ee6b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:03.692144 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa92af9-6056-4f6e-80f8-c6f2c3d3ee6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:03.707972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa92af9-6056-4f6e-80f8-c6f2c3d3ee6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-afa92af9-6056-4f6e-80f8-c6f2c3d3ee6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:03.717703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:03.718667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:03.719541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:03.722772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 420/842] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:05:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:03.728810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa92af9-6056-4f6e-80f8-c6f2c3d3ee6b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:03.763681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:03.797784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f6ac5-f29e-4030-aae2-802b5c6adae6 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:03.836800 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23e884-7aa9-4434-9f59-9b1558c1ddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:03.837857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23e884-7aa9-4434-9f59-9b1558c1ddf2 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:03.838373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23e884-7aa9-4434-9f59-9b1558c1ddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:03.838865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23e884-7aa9-4434-9f59-9b1558c1ddf2 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:03.839915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23e884-7aa9-4434-9f59-9b1558c1ddf2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:03.840412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23e884-7aa9-4434-9f59-9b1558c1ddf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:03.842023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23e884-7aa9-4434-9f59-9b1558c1ddf2 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:03.847431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa92af9-6056-4f6e-80f8-c6f2c3d3ee6b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:03.865857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 423/843] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Jun 28 03:05:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:03.867478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23e884-7aa9-4434-9f59-9b1558c1ddf2 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:03.890770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87932785-e696-49e6-8b99-91c7b0c43c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:03.891493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932785-e696-49e6-8b99-91c7b0c43c3c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:03.891776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932785-e696-49e6-8b99-91c7b0c43c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:03.892052 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932785-e696-49e6-8b99-91c7b0c43c3c None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:03.893086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932785-e696-49e6-8b99-91c7b0c43c3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:03.893398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932785-e696-49e6-8b99-91c7b0c43c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:03.895080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932785-e696-49e6-8b99-91c7b0c43c3c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:03.903025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:03.909484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 421/844] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:05:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:03.915763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87932785-e696-49e6-8b99-91c7b0c43c3c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:03.978757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23e884-7aa9-4434-9f59-9b1558c1ddf2 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:04.010663 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:04.021614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317dd59-64be-40c3-8a37-89ec1a79f43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:04.023085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317dd59-64be-40c3-8a37-89ec1a79f43a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:04.023823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317dd59-64be-40c3-8a37-89ec1a79f43a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:04.024293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317dd59-64be-40c3-8a37-89ec1a79f43a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:04.040678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87932785-e696-49e6-8b99-91c7b0c43c3c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:04.087021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1609698-18c1-4ae2-91c7-d15364414405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:04.088432 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1609698-18c1-4ae2-91c7-d15364414405 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:04.089191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1609698-18c1-4ae2-91c7-d15364414405 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:04.089670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1609698-18c1-4ae2-91c7-d15364414405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:04.104183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1609698-18c1-4ae2-91c7-d15364414405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:04.106130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1609698-18c1-4ae2-91c7-d15364414405 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:04.109245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317dd59-64be-40c3-8a37-89ec1a79f43a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:04.110919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317dd59-64be-40c3-8a37-89ec1a79f43a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d1609698-18c1-4ae2-91c7-d15364414405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:04.129920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:04.131078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:04.131959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:04.131959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:04.131959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:04.131959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:04.137252 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 422/845] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:04.139252 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1609698-18c1-4ae2-91c7-d15364414405 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:04.199346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:04.248776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 424/846] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 28 03:05:04.254124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317dd59-64be-40c3-8a37-89ec1a79f43a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:04.255993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1609698-18c1-4ae2-91c7-d15364414405 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:04.287555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:04.302439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adec2b6-1d08-42de-b014-5f77217f77fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:04.303153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec2b6-1d08-42de-b014-5f77217f77fe None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:04.303690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec2b6-1d08-42de-b014-5f77217f77fe None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:04.303972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec2b6-1d08-42de-b014-5f77217f77fe None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:04.304726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adec2b6-1d08-42de-b014-5f77217f77fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:04.305031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adec2b6-1d08-42de-b014-5f77217f77fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:04.306990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adec2b6-1d08-42de-b014-5f77217f77fe None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:04.322428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 423/847] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:04.327705 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adec2b6-1d08-42de-b014-5f77217f77fe None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:04.366175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317dd59-64be-40c3-8a37-89ec1a79f43a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:04.408721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddd7d2-4a49-4c49-ac8e-20d5c8460933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:04.409546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddd7d2-4a49-4c49-ac8e-20d5c8460933 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:04.409820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddd7d2-4a49-4c49-ac8e-20d5c8460933 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:04.410086 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddd7d2-4a49-4c49-ac8e-20d5c8460933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:04.421326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddd7d2-4a49-4c49-ac8e-20d5c8460933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:04.422930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddd7d2-4a49-4c49-ac8e-20d5c8460933 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-43ddd7d2-4a49-4c49-ac8e-20d5c8460933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:04.442388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:04.443356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:04.444241 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:04.444241 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:04.444241 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:04.444241 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:04.448195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 425/848] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:04.449541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddd7d2-4a49-4c49-ac8e-20d5c8460933 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:04.451878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adec2b6-1d08-42de-b014-5f77217f77fe None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:04.475294 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:04.500203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54273e04-43fc-4a7f-a85d-5b3c993f7e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:04.501544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273e04-43fc-4a7f-a85d-5b3c993f7e2e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:04.502053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273e04-43fc-4a7f-a85d-5b3c993f7e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:04.502492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273e04-43fc-4a7f-a85d-5b3c993f7e2e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:04.511045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54273e04-43fc-4a7f-a85d-5b3c993f7e2e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:04.512744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54273e04-43fc-4a7f-a85d-5b3c993f7e2e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-54273e04-43fc-4a7f-a85d-5b3c993f7e2e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:05:04.527908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:04.529024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:04.530108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:04.530108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:04.530108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:05:04.530108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:05:04.530108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:05:04.530108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:05:04.530108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:05:04.530108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:05:04.530108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 03:05:04.530108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:04.532429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 424/849] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:05:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:04.546046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54273e04-43fc-4a7f-a85d-5b3c993f7e2e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:04.550582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:04.579996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddd7d2-4a49-4c49-ac8e-20d5c8460933 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:04.644353 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c04923-0202-4482-81d3-d8b9dd1c974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:04.645533 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c04923-0202-4482-81d3-d8b9dd1c974d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:04.646007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c04923-0202-4482-81d3-d8b9dd1c974d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:04.646813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c04923-0202-4482-81d3-d8b9dd1c974d None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:04.648373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c04923-0202-4482-81d3-d8b9dd1c974d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:04.648891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c04923-0202-4482-81d3-d8b9dd1c974d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:04.651304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c04923-0202-4482-81d3-d8b9dd1c974d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:04.674820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 426/850] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:04.680069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c04923-0202-4482-81d3-d8b9dd1c974d None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:04.701718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54273e04-43fc-4a7f-a85d-5b3c993f7e2e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:04.738504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f3661-b443-4be3-9244-c4d9dccdbdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:04.739973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3661-b443-4be3-9244-c4d9dccdbdba None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:04.740505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3661-b443-4be3-9244-c4d9dccdbdba None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:04.740972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3661-b443-4be3-9244-c4d9dccdbdba None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:04.742186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f3661-b443-4be3-9244-c4d9dccdbdba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:04.742811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f3661-b443-4be3-9244-c4d9dccdbdba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:04.744461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f3661-b443-4be3-9244-c4d9dccdbdba None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:04.767792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 425/851] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Jun 28 03:05:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:04.767792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f09f-f78f-42d0-a9ca-23ce8ad8fa06 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:04.767792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f09f-f78f-42d0-a9ca-23ce8ad8fa06 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:04.767792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f09f-f78f-42d0-a9ca-23ce8ad8fa06 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:04.767792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 426/852] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:04.769480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770f09f-f78f-42d0-a9ca-23ce8ad8fa06 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:04.801673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:04.811760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c04923-0202-4482-81d3-d8b9dd1c974d None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:04.848392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633beed6-8347-4121-a1c8-9d0210221e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:04.849297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633beed6-8347-4121-a1c8-9d0210221e17 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:04.849647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633beed6-8347-4121-a1c8-9d0210221e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:04.849987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633beed6-8347-4121-a1c8-9d0210221e17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:04.857302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633beed6-8347-4121-a1c8-9d0210221e17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:04.859204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633beed6-8347-4121-a1c8-9d0210221e17 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-633beed6-8347-4121-a1c8-9d0210221e17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:05:04.874254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:04.875379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:04.876292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:05:04.876292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:05:04.876292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:05:04.876292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:05:04.876292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:05:04.876292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:05:04.876292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:04.876292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:04.876292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 427/853] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:04.877426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22410c-3a49-428c-87d5-92cad22ab912 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:04.877426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22410c-3a49-428c-87d5-92cad22ab912 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:04.877549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22410c-3a49-428c-87d5-92cad22ab912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:04.883310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:04.886171 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770f09f-f78f-42d0-a9ca-23ce8ad8fa06 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:04.896507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-ba22410c-3a49-428c-87d5-92cad22ab912 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:04.898357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ba22410c-3a49-428c-87d5-92cad22ab912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:04.924865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb182f-f555-4c38-af9b-75e47dca5b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:04.925514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb182f-f555-4c38-af9b-75e47dca5b91 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:04.925906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb182f-f555-4c38-af9b-75e47dca5b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:04.926180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb182f-f555-4c38-af9b-75e47dca5b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:04.970752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 428/854] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:04.970752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22410c-3a49-428c-87d5-92cad22ab912 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:05.002711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb182f-f555-4c38-af9b-75e47dca5b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:05.004187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb182f-f555-4c38-af9b-75e47dca5b91 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:05.035037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:05.088204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22410c-3a49-428c-87d5-92cad22ab912 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:05.127012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26678a-5e73-4218-a97f-fa5ce7f636ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:05.127702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26678a-5e73-4218-a97f-fa5ce7f636ad None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:05.127987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26678a-5e73-4218-a97f-fa5ce7f636ad None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:05.128233 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26678a-5e73-4218-a97f-fa5ce7f636ad None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:05.129059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26678a-5e73-4218-a97f-fa5ce7f636ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:05.129362 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26678a-5e73-4218-a97f-fa5ce7f636ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:05.130866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26678a-5e73-4218-a97f-fa5ce7f636ad None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:05.133101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:05.150677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 429/855] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:05:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:05.150677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26678a-5e73-4218-a97f-fa5ce7f636ad None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:05.243159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 427/856] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:05:05.244317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb182f-f555-4c38-af9b-75e47dca5b91 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:05.264641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26678a-5e73-4218-a97f-fa5ce7f636ad None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:05.298551 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feef14c-dcc5-413b-8a19-6c667d5a6b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:05.299359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef14c-dcc5-413b-8a19-6c667d5a6b74 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:05.299634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef14c-dcc5-413b-8a19-6c667d5a6b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:05.299900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef14c-dcc5-413b-8a19-6c667d5a6b74 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:05.300549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feef14c-dcc5-413b-8a19-6c667d5a6b74 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:05.301912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feef14c-dcc5-413b-8a19-6c667d5a6b74 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-1feef14c-dcc5-413b-8a19-6c667d5a6b74 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:05.313893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:05.315139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:05.316184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 430/857] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:05:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:05.317177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feef14c-dcc5-413b-8a19-6c667d5a6b74 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:05.348407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb182f-f555-4c38-af9b-75e47dca5b91 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:05.374951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:05.375843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:05.382953 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1cbfe-5b28-49c8-b825-19493565d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:05.383612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1cbfe-5b28-49c8-b825-19493565d85f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:05.383887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1cbfe-5b28-49c8-b825-19493565d85f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:05.384150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1cbfe-5b28-49c8-b825-19493565d85f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:05.384977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1cbfe-5b28-49c8-b825-19493565d85f None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=a7d95e643b984955a20e48f71b204502) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:05.385301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1cbfe-5b28-49c8-b825-19493565d85f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:05.386766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1cbfe-5b28-49c8-b825-19493565d85f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:05.392534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 428/858] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:05 2022] GET /identity/v3/role_assignments?user.id=a7d95e643b984955a20e48f71b204502&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:05.393736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fa8fe-b114-47ac-b25f-dc4a31dfc59b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:05.394014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fa8fe-b114-47ac-b25f-dc4a31dfc59b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:05.394282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fa8fe-b114-47ac-b25f-dc4a31dfc59b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:05.395516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 429/859] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:05.396211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fa8fe-b114-47ac-b25f-dc4a31dfc59b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:05.436323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feef14c-dcc5-413b-8a19-6c667d5a6b74 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:05.477333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6892274-e3b0-4ab7-be72-da3e6741061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:05.478329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6892274-e3b0-4ab7-be72-da3e6741061b None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:05.478663 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6892274-e3b0-4ab7-be72-da3e6741061b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:05.478993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6892274-e3b0-4ab7-be72-da3e6741061b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:05.491438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6892274-e3b0-4ab7-be72-da3e6741061b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:05.493241 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6892274-e3b0-4ab7-be72-da3e6741061b None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:05.513589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fa8fe-b114-47ac-b25f-dc4a31dfc59b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-a6892274-e3b0-4ab7-be72-da3e6741061b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:05.514147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:05.520606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:05.521727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:05.521727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:05.521727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:05.521727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:05.521727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 431/860] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:05.521727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632ff45-a76d-4f63-a114-55fda81cebe6 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:05.521727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632ff45-a76d-4f63-a114-55fda81cebe6 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:05.521727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632ff45-a76d-4f63-a114-55fda81cebe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:05.538750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-3632ff45-a76d-4f63-a114-55fda81cebe6 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:05.540052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3632ff45-a76d-4f63-a114-55fda81cebe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:05.566410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379bc66-f034-4235-a8f0-fd850aac9140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:05.567635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379bc66-f034-4235-a8f0-fd850aac9140 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:05.568255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379bc66-f034-4235-a8f0-fd850aac9140 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:05.568537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379bc66-f034-4235-a8f0-fd850aac9140 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:05.569831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379bc66-f034-4235-a8f0-fd850aac9140 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:05.570609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379bc66-f034-4235-a8f0-fd850aac9140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:05.571467 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379bc66-f034-4235-a8f0-fd850aac9140 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:05.577197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 430/861] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:05:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:05.577573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379bc66-f034-4235-a8f0-fd850aac9140 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:05.618888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 432/862] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:05.620093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632ff45-a76d-4f63-a114-55fda81cebe6 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:05.649386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:05.665822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:05.697248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379bc66-f034-4235-a8f0-fd850aac9140 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:05.727098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632ff45-a76d-4f63-a114-55fda81cebe6 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:05.735185 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c367a7f-dd77-4ef5-85ba-0d5eb0cfda9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:05.735854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367a7f-dd77-4ef5-85ba-0d5eb0cfda9d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:05.736378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367a7f-dd77-4ef5-85ba-0d5eb0cfda9d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:05.736378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367a7f-dd77-4ef5-85ba-0d5eb0cfda9d None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:05.737114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c367a7f-dd77-4ef5-85ba-0d5eb0cfda9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:05.737416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c367a7f-dd77-4ef5-85ba-0d5eb0cfda9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:05.738833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c367a7f-dd77-4ef5-85ba-0d5eb0cfda9d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:05.750707 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 431/863] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:05.755723 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c367a7f-dd77-4ef5-85ba-0d5eb0cfda9d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:05.767454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90acc3e-5e38-4a55-bed5-2d2d7fac365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:05.768434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90acc3e-5e38-4a55-bed5-2d2d7fac365f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:05.768931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90acc3e-5e38-4a55-bed5-2d2d7fac365f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:05.769207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90acc3e-5e38-4a55-bed5-2d2d7fac365f None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:05.769918 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90acc3e-5e38-4a55-bed5-2d2d7fac365f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:05.770222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90acc3e-5e38-4a55-bed5-2d2d7fac365f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:05.771613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90acc3e-5e38-4a55-bed5-2d2d7fac365f None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:05.786326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 433/864] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:05:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:05.786326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90acc3e-5e38-4a55-bed5-2d2d7fac365f None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:05.884338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c367a7f-dd77-4ef5-85ba-0d5eb0cfda9d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:05.898392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90acc3e-5e38-4a55-bed5-2d2d7fac365f None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:05.902502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:05.909913 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:05.935181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b56cb6-d2a1-4b9e-b08b-9ea388a24213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:05.936187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b56cb6-d2a1-4b9e-b08b-9ea388a24213 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:05.936594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b56cb6-d2a1-4b9e-b08b-9ea388a24213 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:05.936878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b56cb6-d2a1-4b9e-b08b-9ea388a24213 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:05.937557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b56cb6-d2a1-4b9e-b08b-9ea388a24213 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:05.940339 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b56cb6-d2a1-4b9e-b08b-9ea388a24213 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:05.945162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2c3f-e83a-480e-ba15-b62661d7c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:05.946258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2c3f-e83a-480e-ba15-b62661d7c08a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:05.946787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2c3f-e83a-480e-ba15-b62661d7c08a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:05.947250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2c3f-e83a-480e-ba15-b62661d7c08a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-08b56cb6-d2a1-4b9e-b08b-9ea388a24213 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:05.955313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:05.956320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 03:05:05.957136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:05.961584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 432/865] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Jun 28 03:05:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:05.962526 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b56cb6-d2a1-4b9e-b08b-9ea388a24213 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:05.962805 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2c3f-e83a-480e-ba15-b62661d7c08a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:05.964455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2c3f-e83a-480e-ba15-b62661d7c08a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-dc2c2c3f-e83a-480e-ba15-b62661d7c08a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:05:05.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:05.983264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:05.984344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:05:05.984344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:05:05.984344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:05:05.984344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:05:05.984344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:05:05.984344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:05:05.984344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:05.984344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:05.986372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 434/866] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:05.992495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2c3f-e83a-480e-ba15-b62661d7c08a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:06.080154 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b56cb6-d2a1-4b9e-b08b-9ea388a24213 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:06.111635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2c3f-e83a-480e-ba15-b62661d7c08a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:06.117746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b27ed-f42a-4b0a-9704-d0bbfc29787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:06.118461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b27ed-f42a-4b0a-9704-d0bbfc29787f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:06.118751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b27ed-f42a-4b0a-9704-d0bbfc29787f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:06.119025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b27ed-f42a-4b0a-9704-d0bbfc29787f None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:06.119846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b27ed-f42a-4b0a-9704-d0bbfc29787f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:06.120158 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b27ed-f42a-4b0a-9704-d0bbfc29787f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:06.121562 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b27ed-f42a-4b0a-9704-d0bbfc29787f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:06.127450 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 433/867] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Jun 28 03:05:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:06.133610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b27ed-f42a-4b0a-9704-d0bbfc29787f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:06.155416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb49ab-d4d4-4479-ab95-91555f464901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:06.156112 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb49ab-d4d4-4479-ab95-91555f464901 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:06.156616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb49ab-d4d4-4479-ab95-91555f464901 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:06.157734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb49ab-d4d4-4479-ab95-91555f464901 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:06.158941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb49ab-d4d4-4479-ab95-91555f464901 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:06.159317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb49ab-d4d4-4479-ab95-91555f464901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:06.161735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb49ab-d4d4-4479-ab95-91555f464901 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:06.180763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 435/868] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:06.186413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb49ab-d4d4-4479-ab95-91555f464901 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:06.188721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:06.222846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:06.246733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b27ed-f42a-4b0a-9704-d0bbfc29787f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:06.281318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30189d08-1ace-4762-8895-b99656099b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:06.282245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30189d08-1ace-4762-8895-b99656099b96 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:06.282448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30189d08-1ace-4762-8895-b99656099b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:06.282687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30189d08-1ace-4762-8895-b99656099b96 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:06.283437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30189d08-1ace-4762-8895-b99656099b96 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:06.283742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30189d08-1ace-4762-8895-b99656099b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:06.285114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30189d08-1ace-4762-8895-b99656099b96 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:06.294886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 434/869] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Jun 28 03:05:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:06.320194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb49ab-d4d4-4479-ab95-91555f464901 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:06.358626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4d497-5844-404f-ba4a-b9d5af01de67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:06.359337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d497-5844-404f-ba4a-b9d5af01de67 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:06.359693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d497-5844-404f-ba4a-b9d5af01de67 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:06.360128 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d497-5844-404f-ba4a-b9d5af01de67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:06.361009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4d497-5844-404f-ba4a-b9d5af01de67 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=9a40d290f0e147b9b62cf3eedf399e6c) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:06.361325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4d497-5844-404f-ba4a-b9d5af01de67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:06.362843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4d497-5844-404f-ba4a-b9d5af01de67 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:06.370777 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 436/870] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:06 2022] GET /identity/v3/role_assignments?user.id=9a40d290f0e147b9b62cf3eedf399e6c&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:07.514587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c688a-f5fb-4e27-bb87-f06314ffc638 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:07.515280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c688a-f5fb-4e27-bb87-f06314ffc638 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:07.515280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c688a-f5fb-4e27-bb87-f06314ffc638 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:07.517020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 435/871] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:07.522515 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a49e7-d586-489f-ad5d-769b10793587 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:07.523019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a49e7-d586-489f-ad5d-769b10793587 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:07.523170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a49e7-d586-489f-ad5d-769b10793587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:07.539994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-928a49e7-d586-489f-ad5d-769b10793587 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:07.541173 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-928a49e7-d586-489f-ad5d-769b10793587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:07.608341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 437/872] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:07.631889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c688a-f5fb-4e27-bb87-f06314ffc638 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:07.736633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c688a-f5fb-4e27-bb87-f06314ffc638 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:07.747445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:07.775695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01a1a0-ba6d-46b3-9bc0-6a7a6643f51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:07.776468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01a1a0-ba6d-46b3-9bc0-6a7a6643f51c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:07.776922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01a1a0-ba6d-46b3-9bc0-6a7a6643f51c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:07.777430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01a1a0-ba6d-46b3-9bc0-6a7a6643f51c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:07.790258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01a1a0-ba6d-46b3-9bc0-6a7a6643f51c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-ac01a1a0-ba6d-46b3-9bc0-6a7a6643f51c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:07.798703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:07.800840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:07.802783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 436/873] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Jun 28 03:05:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:07.806636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a49e7-d586-489f-ad5d-769b10793587 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:07.831149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:07.918423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a49e7-d586-489f-ad5d-769b10793587 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:07.938108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed4da-076d-4ab4-9bdd-7617b2daeb1f None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:07.938448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed4da-076d-4ab4-9bdd-7617b2daeb1f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:07.938694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed4da-076d-4ab4-9bdd-7617b2daeb1f None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:07.940344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 437/874] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:07.948054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7f1c-30da-4759-8955-fac82fd9e714 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:07.948054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7f1c-30da-4759-8955-fac82fd9e714 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:07.948054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7f1c-30da-4759-8955-fac82fd9e714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:07.957674 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb2e7-d0c5-47b8-9f0d-12c2bb0b2a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:07.958408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb2e7-d0c5-47b8-9f0d-12c2bb0b2a98 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:07.958691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb2e7-d0c5-47b8-9f0d-12c2bb0b2a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:07.958963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb2e7-d0c5-47b8-9f0d-12c2bb0b2a98 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:07.960284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdb2e7-d0c5-47b8-9f0d-12c2bb0b2a98 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:07.960601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdb2e7-d0c5-47b8-9f0d-12c2bb0b2a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:07.961986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdb2e7-d0c5-47b8-9f0d-12c2bb0b2a98 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:07.966530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-77bf7f1c-30da-4759-8955-fac82fd9e714 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:07.968057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-77bf7f1c-30da-4759-8955-fac82fd9e714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:07.972411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 438/875] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Jun 28 03:05:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:07.978337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb2e7-d0c5-47b8-9f0d-12c2bb0b2a98 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:08.048953 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 438/876] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:08.073753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7f1c-30da-4759-8955-fac82fd9e714 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:08.084171 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:08.109097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb2e7-d0c5-47b8-9f0d-12c2bb0b2a98 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:08.152017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b32bbd-8fe6-4217-a625-f0ccbefa95ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:08.152833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32bbd-8fe6-4217-a625-f0ccbefa95ed None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:08.153110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32bbd-8fe6-4217-a625-f0ccbefa95ed None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:08.153377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32bbd-8fe6-4217-a625-f0ccbefa95ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:08.167177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b32bbd-8fe6-4217-a625-f0ccbefa95ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:08.169032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b32bbd-8fe6-4217-a625-f0ccbefa95ed None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-57b32bbd-8fe6-4217-a625-f0ccbefa95ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:08.188574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:08.189544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:08.190495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:08.190495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:08.190495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:08.190495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:08.192759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 439/877] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:08.199271 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b32bbd-8fe6-4217-a625-f0ccbefa95ed None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:08.206835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:08.209657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7f1c-30da-4759-8955-fac82fd9e714 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:08.252126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4426bf2-e405-47a0-bcb0-c6a6911b453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:08.253118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4426bf2-e405-47a0-bcb0-c6a6911b453d None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:08.253408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4426bf2-e405-47a0-bcb0-c6a6911b453d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:08.253679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4426bf2-e405-47a0-bcb0-c6a6911b453d None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:08.254726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4426bf2-e405-47a0-bcb0-c6a6911b453d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:08.256273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4426bf2-e405-47a0-bcb0-c6a6911b453d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:08.282336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 439/878] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:05:08 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:08.322419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b32bbd-8fe6-4217-a625-f0ccbefa95ed None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:08.357679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:08.371482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2d7d7-1031-4e17-8c61-06bd0f2144b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:08.372230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d7d7-1031-4e17-8c61-06bd0f2144b2 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:08.372514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d7d7-1031-4e17-8c61-06bd0f2144b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:08.372786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d7d7-1031-4e17-8c61-06bd0f2144b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:08.373580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2d7d7-1031-4e17-8c61-06bd0f2144b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:08.373889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2d7d7-1031-4e17-8c61-06bd0f2144b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:08.375375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2d7d7-1031-4e17-8c61-06bd0f2144b2 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:08.389730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 440/879] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:08.395629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4426bf2-e405-47a0-bcb0-c6a6911b453d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:08.406475 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91026ad-873c-4330-96f1-5f9c34b679ed None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:08.406894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91026ad-873c-4330-96f1-5f9c34b679ed None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:08.407193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91026ad-873c-4330-96f1-5f9c34b679ed None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:08.408780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 441/880] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:08.414377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60730d5-3c76-4f95-be76-630f8d4b1dc6 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:08.414671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60730d5-3c76-4f95-be76-630f8d4b1dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:08.414949 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60730d5-3c76-4f95-be76-630f8d4b1dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:08.433014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-a60730d5-3c76-4f95-be76-630f8d4b1dc6 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:08.434230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a60730d5-3c76-4f95-be76-630f8d4b1dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:08.512649 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 442/881] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:08.514341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d586c-f5ea-4775-a510-4d7ef4dadf31 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:08.514863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d586c-f5ea-4775-a510-4d7ef4dadf31 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:08.515200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d586c-f5ea-4775-a510-4d7ef4dadf31 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:08.516722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 443/882] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:08.520168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4426bf2-e405-47a0-bcb0-c6a6911b453d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:08.522056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42354fb7-bf3f-4f3f-94a2-aa65186de2d0 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:08.522433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42354fb7-bf3f-4f3f-94a2-aa65186de2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:08.522802 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42354fb7-bf3f-4f3f-94a2-aa65186de2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:08.540529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-42354fb7-bf3f-4f3f-94a2-aa65186de2d0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:08.541794 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-42354fb7-bf3f-4f3f-94a2-aa65186de2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:08.556753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dcd39-d462-4537-94e0-8f5ea1424416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:08.557861 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dcd39-d462-4537-94e0-8f5ea1424416 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:08.558333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dcd39-d462-4537-94e0-8f5ea1424416 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:08.558603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dcd39-d462-4537-94e0-8f5ea1424416 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:08.566976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dcd39-d462-4537-94e0-8f5ea1424416 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:08.568425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dcd39-d462-4537-94e0-8f5ea1424416 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-145dcd39-d462-4537-94e0-8f5ea1424416 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:05:08.583402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:08.584382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 440/883] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Jun 28 03:05:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:08.585927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dcd39-d462-4537-94e0-8f5ea1424416 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:08.610082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:08.619766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 444/884] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:08.627206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42354fb7-bf3f-4f3f-94a2-aa65186de2d0 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:08.683242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:08.700621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dcd39-d462-4537-94e0-8f5ea1424416 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:08.735316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9559e-38c2-4c57-b81c-41cc684d162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:08.736006 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9559e-38c2-4c57-b81c-41cc684d162b None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:08.736268 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9559e-38c2-4c57-b81c-41cc684d162b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:08.736532 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9559e-38c2-4c57-b81c-41cc684d162b None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:08.737250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9559e-38c2-4c57-b81c-41cc684d162b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:08.738650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9559e-38c2-4c57-b81c-41cc684d162b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:08.740209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42354fb7-bf3f-4f3f-94a2-aa65186de2d0 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:08.756199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 441/885] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:05:08 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:08.757425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9559e-38c2-4c57-b81c-41cc684d162b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:08.808754 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d41440-2f62-4e10-8c06-5d42d0e06655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:08.809461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d41440-2f62-4e10-8c06-5d42d0e06655 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:08.809742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d41440-2f62-4e10-8c06-5d42d0e06655 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:08.810058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d41440-2f62-4e10-8c06-5d42d0e06655 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:08.810951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d41440-2f62-4e10-8c06-5d42d0e06655 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:08.811325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d41440-2f62-4e10-8c06-5d42d0e06655 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:08.813651 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d41440-2f62-4e10-8c06-5d42d0e06655 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:08.838721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 445/886] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Jun 28 03:05:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:08.843994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d41440-2f62-4e10-8c06-5d42d0e06655 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:08.879542 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:08.907004 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9559e-38c2-4c57-b81c-41cc684d162b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:08.953637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a512f-57f1-4fe7-8f43-dffc088e6bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:08.954844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a512f-57f1-4fe7-8f43-dffc088e6bcf None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:08.955302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a512f-57f1-4fe7-8f43-dffc088e6bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:08.955748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a512f-57f1-4fe7-8f43-dffc088e6bcf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:08.957145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a512f-57f1-4fe7-8f43-dffc088e6bcf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:08.957840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a512f-57f1-4fe7-8f43-dffc088e6bcf None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-7f5a512f-57f1-4fe7-8f43-dffc088e6bcf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:08.970742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:08.971780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:08.972604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 442/887] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Jun 28 03:05:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:08.977977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a512f-57f1-4fe7-8f43-dffc088e6bcf None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:08.981679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d41440-2f62-4e10-8c06-5d42d0e06655 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:08.983547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:09.027455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92f7b-c5ba-429c-8b26-2d090c317c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:09.028294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92f7b-c5ba-429c-8b26-2d090c317c6e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:09.028667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92f7b-c5ba-429c-8b26-2d090c317c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:09.029035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92f7b-c5ba-429c-8b26-2d090c317c6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:09.109964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a512f-57f1-4fe7-8f43-dffc088e6bcf None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:09.119405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc92f7b-c5ba-429c-8b26-2d090c317c6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:09.121139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc92f7b-c5ba-429c-8b26-2d090c317c6e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:09.147292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc2fea-d02f-4827-878b-956dba3e2a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:09.148125 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc2fea-d02f-4827-878b-956dba3e2a6a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:09.148505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc2fea-d02f-4827-878b-956dba3e2a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:09.148880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc2fea-d02f-4827-878b-956dba3e2a6a None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:09.149693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc2fea-d02f-4827-878b-956dba3e2a6a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:09.150221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc2fea-d02f-4827-878b-956dba3e2a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:09.151581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc2fea-d02f-4827-878b-956dba3e2a6a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:09.157023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 443/888] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Jun 28 03:05:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:09.162811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc2fea-d02f-4827-878b-956dba3e2a6a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:09.178251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:09.241657 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 446/889] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:08 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 28 03:05:09.246932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92f7b-c5ba-429c-8b26-2d090c317c6e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:09.248980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:09.285189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc2fea-d02f-4827-878b-956dba3e2a6a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:09.326697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63f792-3842-4af7-8f01-55957438bcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:09.327537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f792-3842-4af7-8f01-55957438bcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:09.327933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f792-3842-4af7-8f01-55957438bcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:09.328815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f792-3842-4af7-8f01-55957438bcb1 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:09.329642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63f792-3842-4af7-8f01-55957438bcb1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:09.330049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63f792-3842-4af7-8f01-55957438bcb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:09.332008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63f792-3842-4af7-8f01-55957438bcb1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:09.338377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 444/890] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Jun 28 03:05:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:09.358252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92f7b-c5ba-429c-8b26-2d090c317c6e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:09.399122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f3237-3514-4cf3-976a-77a1978c844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:09.400255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3237-3514-4cf3-976a-77a1978c844a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:09.400687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3237-3514-4cf3-976a-77a1978c844a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:09.401099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3237-3514-4cf3-976a-77a1978c844a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:09.413763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f3237-3514-4cf3-976a-77a1978c844a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:09.415533 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f3237-3514-4cf3-976a-77a1978c844a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-302f3237-3514-4cf3-976a-77a1978c844a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:09.436052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:09.437187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:09.438442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:09.438442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:09.438442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:09.438442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:09.440421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 447/891] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:09.450412 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63f792-3842-4af7-8f01-55957438bcb1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:09.523145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:09.554208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63f792-3842-4af7-8f01-55957438bcb1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:09.588494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3f7f8-23aa-48bf-9d1d-a05c2e3a508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:09.589176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f7f8-23aa-48bf-9d1d-a05c2e3a508a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:09.589470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f7f8-23aa-48bf-9d1d-a05c2e3a508a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:09.589726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f7f8-23aa-48bf-9d1d-a05c2e3a508a None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:09.590485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3f7f8-23aa-48bf-9d1d-a05c2e3a508a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:09.590788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3f7f8-23aa-48bf-9d1d-a05c2e3a508a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:09.592168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3f7f8-23aa-48bf-9d1d-a05c2e3a508a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:09.604723 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 445/892] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:09.610346 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f3237-3514-4cf3-976a-77a1978c844a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:09.672080 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:09.718437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f3237-3514-4cf3-976a-77a1978c844a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:09.753707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7487a-a87c-488f-aebf-c835a64eb493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:09.754543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7487a-a87c-488f-aebf-c835a64eb493 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:09.754823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7487a-a87c-488f-aebf-c835a64eb493 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:09.755091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7487a-a87c-488f-aebf-c835a64eb493 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:09.762007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7487a-a87c-488f-aebf-c835a64eb493 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:09.763481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7487a-a87c-488f-aebf-c835a64eb493 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-29e7487a-a87c-488f-aebf-c835a64eb493 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:05:09.777337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:09.778237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:09.779150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:05:09.779150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:05:09.779150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:05:09.779150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:05:09.779150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:05:09.779150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:05:09.779150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:09.779150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:09.779150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 448/893] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:09.784598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3f7f8-23aa-48bf-9d1d-a05c2e3a508a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:09.885966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3f7f8-23aa-48bf-9d1d-a05c2e3a508a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:09.916554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:09.921705 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c69fd5-0aec-4196-90de-5bc5fd21b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:09.922576 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69fd5-0aec-4196-90de-5bc5fd21b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:09.922939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69fd5-0aec-4196-90de-5bc5fd21b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:09.923215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69fd5-0aec-4196-90de-5bc5fd21b8a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:09.924011 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c69fd5-0aec-4196-90de-5bc5fd21b8a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:09.924315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c69fd5-0aec-4196-90de-5bc5fd21b8a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:09.925843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c69fd5-0aec-4196-90de-5bc5fd21b8a2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:09.938250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 446/894] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:09.944398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7487a-a87c-488f-aebf-c835a64eb493 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:10.060584 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7487a-a87c-488f-aebf-c835a64eb493 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:10.075482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:10.096560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f994c-acfc-4af6-8815-a648a20254c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:10.097235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f994c-acfc-4af6-8815-a648a20254c3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:10.097525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f994c-acfc-4af6-8815-a648a20254c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:10.097796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f994c-acfc-4af6-8815-a648a20254c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:10.098664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f994c-acfc-4af6-8815-a648a20254c3 None admin] RBAC: Adding query filter params (role.id=421505fc5382430bb34c838f9ac50c45, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=a7d95e643b984955a20e48f71b204502) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:10.098972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f994c-acfc-4af6-8815-a648a20254c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:10.100407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f994c-acfc-4af6-8815-a648a20254c3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:10.106578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 449/895] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:09 2022] GET /identity/v3/role_assignments?user.id=a7d95e643b984955a20e48f71b204502&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=421505fc5382430bb34c838f9ac50c45 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:10.403877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37240ba-60a2-47c0-9e49-41e817d0b9f4 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:10.404266 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37240ba-60a2-47c0-9e49-41e817d0b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:10.404466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37240ba-60a2-47c0-9e49-41e817d0b9f4 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:10.406067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 447/896] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:10.411600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2b46-55c7-40d3-bcc8-1c5337eb8403 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:10.411887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2b46-55c7-40d3-bcc8-1c5337eb8403 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:10.412158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2b46-55c7-40d3-bcc8-1c5337eb8403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:10.429242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e6be2b46-55c7-40d3-bcc8-1c5337eb8403 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:10.430467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e6be2b46-55c7-40d3-bcc8-1c5337eb8403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:10.504958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 450/897] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:10.527104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37240ba-60a2-47c0-9e49-41e817d0b9f4 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:10.633299 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37240ba-60a2-47c0-9e49-41e817d0b9f4 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:10.667656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c00949-f0c8-4d13-8f84-53e5321e603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:10.668701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00949-f0c8-4d13-8f84-53e5321e603d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:10.669142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00949-f0c8-4d13-8f84-53e5321e603d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:10.669551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00949-f0c8-4d13-8f84-53e5321e603d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:10.670372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c00949-f0c8-4d13-8f84-53e5321e603d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:10.671902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c00949-f0c8-4d13-8f84-53e5321e603d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d7c00949-f0c8-4d13-8f84-53e5321e603d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:10.684217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:10.685381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 03:05:10.686404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:10.689396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 448/898] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:05:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:10.695642 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2b46-55c7-40d3-bcc8-1c5337eb8403 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:10.800085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2b46-55c7-40d3-bcc8-1c5337eb8403 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:10.810213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:10.837422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410fb23-7ec0-4030-a274-3ab730146b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:10.838107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410fb23-7ec0-4030-a274-3ab730146b17 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:10.838424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410fb23-7ec0-4030-a274-3ab730146b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:10.838694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410fb23-7ec0-4030-a274-3ab730146b17 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:10.839409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410fb23-7ec0-4030-a274-3ab730146b17 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:10.839711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410fb23-7ec0-4030-a274-3ab730146b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:10.841163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410fb23-7ec0-4030-a274-3ab730146b17 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:10.846611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 451/899] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:05:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:10.851923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c00949-f0c8-4d13-8f84-53e5321e603d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:10.911286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:10.958966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c00949-f0c8-4d13-8f84-53e5321e603d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:10.993891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c7223-b5ca-4b5f-87f6-5ab3b32e812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:10.994598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c7223-b5ca-4b5f-87f6-5ab3b32e812a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:10.994876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c7223-b5ca-4b5f-87f6-5ab3b32e812a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:10.995144 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c7223-b5ca-4b5f-87f6-5ab3b32e812a None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:10.995859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c7223-b5ca-4b5f-87f6-5ab3b32e812a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:10.996160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c7223-b5ca-4b5f-87f6-5ab3b32e812a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:10.997536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c7223-b5ca-4b5f-87f6-5ab3b32e812a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:11.003459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 449/900] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:05:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:11.005335 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56779-84eb-4cfe-af4b-8bb43db676e3 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.005571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56779-84eb-4cfe-af4b-8bb43db676e3 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.005849 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56779-84eb-4cfe-af4b-8bb43db676e3 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.007549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 452/901] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:11.009501 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c7223-b5ca-4b5f-87f6-5ab3b32e812a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:11.012330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198e7f-47ff-40a2-aaa4-f092fb5f1818 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.012612 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198e7f-47ff-40a2-aaa4-f092fb5f1818 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.012882 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198e7f-47ff-40a2-aaa4-f092fb5f1818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.030172 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-63198e7f-47ff-40a2-aaa4-f092fb5f1818 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:11.031481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-63198e7f-47ff-40a2-aaa4-f092fb5f1818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:11.106389 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 453/902] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:11.112137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c7223-b5ca-4b5f-87f6-5ab3b32e812a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:11.124677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198e7f-47ff-40a2-aaa4-f092fb5f1818 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:11.133077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:11.149181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc769e5-47c2-4366-8552-9d24169b7e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:11.149849 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc769e5-47c2-4366-8552-9d24169b7e73 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.150122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc769e5-47c2-4366-8552-9d24169b7e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.150448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc769e5-47c2-4366-8552-9d24169b7e73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.151244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc769e5-47c2-4366-8552-9d24169b7e73 None admin] RBAC: Adding query filter params (interface=public, service_id=161c97a04cef4d448fe4fd6c28f54b80, region_id=RegionOne) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:11.151550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc769e5-47c2-4366-8552-9d24169b7e73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:11.152932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc769e5-47c2-4366-8552-9d24169b7e73 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:11.162850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 450/903] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Jun 28 03:05:11 2022] GET /identity/v3/endpoints?service_id=161c97a04cef4d448fe4fd6c28f54b80&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:11.163720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc769e5-47c2-4366-8552-9d24169b7e73 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:11.228120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198e7f-47ff-40a2-aaa4-f092fb5f1818 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:11.229550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:11.266181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11526f8e-a342-4a70-8a82-4344276f5698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:11.267177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11526f8e-a342-4a70-8a82-4344276f5698 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.267459 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11526f8e-a342-4a70-8a82-4344276f5698 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.267728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11526f8e-a342-4a70-8a82-4344276f5698 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.268402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11526f8e-a342-4a70-8a82-4344276f5698 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:11.269503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc769e5-47c2-4366-8552-9d24169b7e73 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:11.269807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11526f8e-a342-4a70-8a82-4344276f5698 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-11526f8e-a342-4a70-8a82-4344276f5698 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:11.283953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:11.284970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 03:05:11.285821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:11.290312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 454/904] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Jun 28 03:05:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:11.291632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11526f8e-a342-4a70-8a82-4344276f5698 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:11.305266 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f67b9-bf2f-47d7-bbde-d135fddeed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:11.305938 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f67b9-bf2f-47d7-bbde-d135fddeed3f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.306218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f67b9-bf2f-47d7-bbde-d135fddeed3f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.306519 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f67b9-bf2f-47d7-bbde-d135fddeed3f None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.307211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f67b9-bf2f-47d7-bbde-d135fddeed3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:11.308584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f67b9-bf2f-47d7-bbde-d135fddeed3f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:11.321905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 451/905] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Jun 28 03:05:11 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:05:11.408947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11526f8e-a342-4a70-8a82-4344276f5698 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:11.411531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2584750-b02d-40c2-805b-52586aeb026d None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.411812 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2584750-b02d-40c2-805b-52586aeb026d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.412089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2584750-b02d-40c2-805b-52586aeb026d None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.417673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 452/906] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:05:11.419513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46cfc-a4ea-42c9-b2e8-c54138e4ee8d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.419799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46cfc-a4ea-42c9-b2e8-c54138e4ee8d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.420068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46cfc-a4ea-42c9-b2e8-c54138e4ee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.438812 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-dbc46cfc-a4ea-42c9-b2e8-c54138e4ee8d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:11.440071 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-dbc46cfc-a4ea-42c9-b2e8-c54138e4ee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:11.451354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa10245-c30c-45f8-9434-c2497df3643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:11.452055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa10245-c30c-45f8-9434-c2497df3643c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.452338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa10245-c30c-45f8-9434-c2497df3643c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.452698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa10245-c30c-45f8-9434-c2497df3643c None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.453507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa10245-c30c-45f8-9434-c2497df3643c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:11.453861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa10245-c30c-45f8-9434-c2497df3643c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:11.455328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa10245-c30c-45f8-9434-c2497df3643c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:11.461222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 455/907] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Jun 28 03:05:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:11.467250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa10245-c30c-45f8-9434-c2497df3643c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:11.500600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:11.509487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:11.537495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 453/908] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:11.558195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc46cfc-a4ea-42c9-b2e8-c54138e4ee8d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:11.593710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa10245-c30c-45f8-9434-c2497df3643c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:11.633768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bb50-54c8-4589-9309-0dbbbefdfca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:11.634554 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bb50-54c8-4589-9309-0dbbbefdfca7 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.634836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bb50-54c8-4589-9309-0dbbbefdfca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.635109 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bb50-54c8-4589-9309-0dbbbefdfca7 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.635883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204bb50-54c8-4589-9309-0dbbbefdfca7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:11.636187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204bb50-54c8-4589-9309-0dbbbefdfca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:11.637659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204bb50-54c8-4589-9309-0dbbbefdfca7 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:11.643543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 456/909] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Jun 28 03:05:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:11.649142 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bb50-54c8-4589-9309-0dbbbefdfca7 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:11.666039 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc46cfc-a4ea-42c9-b2e8-c54138e4ee8d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:11.705204 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3885c9-e0c8-4fdf-a845-3de457ca8f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:11.706403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3885c9-e0c8-4fdf-a845-3de457ca8f95 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.706941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3885c9-e0c8-4fdf-a845-3de457ca8f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.707430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3885c9-e0c8-4fdf-a845-3de457ca8f95 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.708433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3885c9-e0c8-4fdf-a845-3de457ca8f95 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:11.710262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3885c9-e0c8-4fdf-a845-3de457ca8f95 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:11.734583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 454/910] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:05:11 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:11.759559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:11.766613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bb50-54c8-4589-9309-0dbbbefdfca7 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:11.810904 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0394e-4de8-49db-a97f-00da231525d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:11.811586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0394e-4de8-49db-a97f-00da231525d3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.811863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0394e-4de8-49db-a97f-00da231525d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.812131 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0394e-4de8-49db-a97f-00da231525d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.813276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0394e-4de8-49db-a97f-00da231525d3 None admin] RBAC: Adding query filter params (interface=public, service_id=0d1901ef00aa4816b7a980e96216b789, region_id=RegionOne) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:11.813857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0394e-4de8-49db-a97f-00da231525d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:11.814964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0394e-4de8-49db-a97f-00da231525d3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:11.821487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 457/911] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Jun 28 03:05:11 2022] GET /identity/v3/endpoints?service_id=0d1901ef00aa4816b7a980e96216b789&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:11.827184 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3885c9-e0c8-4fdf-a845-3de457ca8f95 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:11.871322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:11.946447 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3885c9-e0c8-4fdf-a845-3de457ca8f95 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:11.983122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0ea20-a98c-419e-a449-367cb10016d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:11.984078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ea20-a98c-419e-a449-367cb10016d4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:11.984641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ea20-a98c-419e-a449-367cb10016d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:11.985127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ea20-a98c-419e-a449-367cb10016d4 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:11.985991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0ea20-a98c-419e-a449-367cb10016d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:11.987571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0ea20-a98c-419e-a449-367cb10016d4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:11.994949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 455/912] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Jun 28 03:05:11 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:05:12.232140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9013-bee3-4fce-a005-230769a6bac0 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:12.232419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9013-bee3-4fce-a005-230769a6bac0 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:12.232801 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9013-bee3-4fce-a005-230769a6bac0 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:12.234524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 458/913] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:12.240190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3d0d7-483e-42b9-83f2-b4c61683ad39 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:12.240478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3d0d7-483e-42b9-83f2-b4c61683ad39 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:12.240750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3d0d7-483e-42b9-83f2-b4c61683ad39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:12.258082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b3a3d0d7-483e-42b9-83f2-b4c61683ad39 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:12.259304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b3a3d0d7-483e-42b9-83f2-b4c61683ad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:12.329659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 456/914] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:12.351635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e9013-bee3-4fce-a005-230769a6bac0 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:12.455110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e9013-bee3-4fce-a005-230769a6bac0 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:12.493217 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1616-c7d0-4d12-b0f5-afa16ae30e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:12.494102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1616-c7d0-4d12-b0f5-afa16ae30e0d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:12.494457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1616-c7d0-4d12-b0f5-afa16ae30e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:12.494730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1616-c7d0-4d12-b0f5-afa16ae30e0d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:12.507014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b1616-c7d0-4d12-b0f5-afa16ae30e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-cf2b1616-c7d0-4d12-b0f5-afa16ae30e0d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:12.515297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:12.516906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:12.518314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 459/915] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Jun 28 03:05:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:12.522836 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3d0d7-483e-42b9-83f2-b4c61683ad39 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:12.558183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:12.631797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3d0d7-483e-42b9-83f2-b4c61683ad39 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:12.667075 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b8959-ad5b-4eb1-8d50-8b54b616d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:12.668121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b8959-ad5b-4eb1-8d50-8b54b616d130 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:12.668615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b8959-ad5b-4eb1-8d50-8b54b616d130 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:12.669090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b8959-ad5b-4eb1-8d50-8b54b616d130 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:12.670045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b8959-ad5b-4eb1-8d50-8b54b616d130 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:12.670589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b8959-ad5b-4eb1-8d50-8b54b616d130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:12.672794 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b8959-ad5b-4eb1-8d50-8b54b616d130 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:12.681482 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 457/916] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Jun 28 03:05:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:12.689742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1616-c7d0-4d12-b0f5-afa16ae30e0d None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:12.703113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:12.790899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1616-c7d0-4d12-b0f5-afa16ae30e0d None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:12.829265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db5272-aad5-4536-9873-ea8955d318e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:12.830076 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db5272-aad5-4536-9873-ea8955d318e8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:12.830384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db5272-aad5-4536-9873-ea8955d318e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:12.830663 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db5272-aad5-4536-9873-ea8955d318e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:12.841320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db5272-aad5-4536-9873-ea8955d318e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:12.842816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db5272-aad5-4536-9873-ea8955d318e8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-15db5272-aad5-4536-9873-ea8955d318e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:12.868648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:12.869614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:12.870732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:12.870732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:12.870732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:12.870732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:12.870732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 460/917] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:12.875879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b8959-ad5b-4eb1-8d50-8b54b616d130 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:12.976589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:12.985022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b8959-ad5b-4eb1-8d50-8b54b616d130 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:13.023831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3524ca-dafe-4cd9-8bfb-b81c1e01fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:13.024503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3524ca-dafe-4cd9-8bfb-b81c1e01fede None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:13.024779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3524ca-dafe-4cd9-8bfb-b81c1e01fede None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:13.025047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3524ca-dafe-4cd9-8bfb-b81c1e01fede None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:13.025768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3524ca-dafe-4cd9-8bfb-b81c1e01fede None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:13.026066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3524ca-dafe-4cd9-8bfb-b81c1e01fede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:13.027468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3524ca-dafe-4cd9-8bfb-b81c1e01fede None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:13.041645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 458/918] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:13.048046 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db5272-aad5-4536-9873-ea8955d318e8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:13.121926 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:13.159529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db5272-aad5-4536-9873-ea8955d318e8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:13.193996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965006c-0d88-481c-b383-12d49ac7d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:13.194858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965006c-0d88-481c-b383-12d49ac7d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:13.195139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965006c-0d88-481c-b383-12d49ac7d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:13.195415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965006c-0d88-481c-b383-12d49ac7d4d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:13.203574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965006c-0d88-481c-b383-12d49ac7d4d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:13.205074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965006c-0d88-481c-b383-12d49ac7d4d3 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-4965006c-0d88-481c-b383-12d49ac7d4d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:05:13.220331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:13.221386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:13.222791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:13.222791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:13.222791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:05:13.222791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:05:13.222791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:05:13.222791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:05:13.222791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:05:13.222791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:05:13.222791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:05:13.222791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:13.222791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 461/919] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Jun 28 03:05:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:13.228012 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3524ca-dafe-4cd9-8bfb-b81c1e01fede None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:13.334999 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3524ca-dafe-4cd9-8bfb-b81c1e01fede None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:13.370329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf14539-f648-42a8-bc72-40b6bde161f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:13.371021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf14539-f648-42a8-bc72-40b6bde161f8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:13.371301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf14539-f648-42a8-bc72-40b6bde161f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:13.371568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf14539-f648-42a8-bc72-40b6bde161f8 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:13.372411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf14539-f648-42a8-bc72-40b6bde161f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:13.372714 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf14539-f648-42a8-bc72-40b6bde161f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:13.374155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf14539-f648-42a8-bc72-40b6bde161f8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:13.394464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 459/920] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Jun 28 03:05:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:13.400007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965006c-0d88-481c-b383-12d49ac7d4d3 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:13.412330 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cf01e-3fcb-4bb0-b3b4-fb7c6413ee87 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:13.412621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cf01e-3fcb-4bb0-b3b4-fb7c6413ee87 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:13.412880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cf01e-3fcb-4bb0-b3b4-fb7c6413ee87 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:13.414514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 460/921] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:05:13.419811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81c71a-7c55-477b-87cf-4c459cf4da83 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:13.420035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81c71a-7c55-477b-87cf-4c459cf4da83 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:13.420210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81c71a-7c55-477b-87cf-4c459cf4da83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:13.438324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fc81c71a-7c55-477b-87cf-4c459cf4da83 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:13.439582 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fc81c71a-7c55-477b-87cf-4c459cf4da83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:13.447448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:13.512307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965006c-0d88-481c-b383-12d49ac7d4d3 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:13.518419 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 461/922] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:13.536760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81c71a-7c55-477b-87cf-4c459cf4da83 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:13.539740 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:13.550148 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7f77c-374c-483e-b65f-d06de7a3d04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:13.551413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7f77c-374c-483e-b65f-d06de7a3d04f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:13.551912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7f77c-374c-483e-b65f-d06de7a3d04f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:13.552410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7f77c-374c-483e-b65f-d06de7a3d04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:13.564574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7f77c-374c-483e-b65f-d06de7a3d04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:13.566418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7f77c-374c-483e-b65f-d06de7a3d04f None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-31c7f77c-374c-483e-b65f-d06de7a3d04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:13.585419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:13.586412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:13.587310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:13.587310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:13.587310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:13.587310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:13.589721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 462/923] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:13.595691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7f77c-374c-483e-b65f-d06de7a3d04f None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:13.643014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81c71a-7c55-477b-87cf-4c459cf4da83 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:13.678433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdcdf7-076e-4f56-8613-bb4c6b4f0962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:13.679249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdcdf7-076e-4f56-8613-bb4c6b4f0962 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:13.679526 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdcdf7-076e-4f56-8613-bb4c6b4f0962 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:13.679793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdcdf7-076e-4f56-8613-bb4c6b4f0962 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:13.680447 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdcdf7-076e-4f56-8613-bb4c6b4f0962 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:13.681818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdcdf7-076e-4f56-8613-bb4c6b4f0962 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b4bdcdf7-076e-4f56-8613-bb4c6b4f0962 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:13.694677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:13.695831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 03:05:13.696677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:13.700933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 462/924] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:05:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:13.702272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdcdf7-076e-4f56-8613-bb4c6b4f0962 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:13.712500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:13.714415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7f77c-374c-483e-b65f-d06de7a3d04f None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:13.763545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85542f78-135f-4d3c-8ab0-04dd48dbfd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:13.764398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85542f78-135f-4d3c-8ab0-04dd48dbfd64 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:13.764682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85542f78-135f-4d3c-8ab0-04dd48dbfd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:13.764959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85542f78-135f-4d3c-8ab0-04dd48dbfd64 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:13.766402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85542f78-135f-4d3c-8ab0-04dd48dbfd64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:13.766714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85542f78-135f-4d3c-8ab0-04dd48dbfd64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:13.768731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85542f78-135f-4d3c-8ab0-04dd48dbfd64 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:13.785167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 463/925] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:13.790610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85542f78-135f-4d3c-8ab0-04dd48dbfd64 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:13.814331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdcdf7-076e-4f56-8613-bb4c6b4f0962 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:13.846516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:13.852265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11111f36-9447-4fb9-be03-1f42fca35880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:13.852990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11111f36-9447-4fb9-be03-1f42fca35880 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:13.853341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11111f36-9447-4fb9-be03-1f42fca35880 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:13.853832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11111f36-9447-4fb9-be03-1f42fca35880 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:13.854679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11111f36-9447-4fb9-be03-1f42fca35880 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:13.855325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11111f36-9447-4fb9-be03-1f42fca35880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:13.856835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11111f36-9447-4fb9-be03-1f42fca35880 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:13.868218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 463/926] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:05:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:13.869780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11111f36-9447-4fb9-be03-1f42fca35880 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:13.914991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85542f78-135f-4d3c-8ab0-04dd48dbfd64 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:13.949177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:13.950576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bdc3d-26cd-4f15-9a5c-968f2e8f91a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:13.951379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bdc3d-26cd-4f15-9a5c-968f2e8f91a7 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:13.951847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bdc3d-26cd-4f15-9a5c-968f2e8f91a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:13.952074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bdc3d-26cd-4f15-9a5c-968f2e8f91a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:13.960364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bdc3d-26cd-4f15-9a5c-968f2e8f91a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:13.961807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bdc3d-26cd-4f15-9a5c-968f2e8f91a7 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-619bdc3d-26cd-4f15-9a5c-968f2e8f91a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:05:13.976530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:13.977454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:13.978372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:05:13.978372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:05:13.978372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:05:13.978372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:05:13.978372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:05:13.978372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:05:13.978372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:13.978372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:13.978372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 464/927] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:13.979666 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4105474-944d-4a27-bb04-38dcf1eee367 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:13.979666 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4105474-944d-4a27-bb04-38dcf1eee367 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:13.979666 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4105474-944d-4a27-bb04-38dcf1eee367 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:13.985615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 465/928] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:13.985615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4105474-944d-4a27-bb04-38dcf1eee367 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:13.991706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11111f36-9447-4fb9-be03-1f42fca35880 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:14.027690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d4829-df2d-4c02-99db-e7ec2e791737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:14.028397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4829-df2d-4c02-99db-e7ec2e791737 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.028680 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4829-df2d-4c02-99db-e7ec2e791737 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.028951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4829-df2d-4c02-99db-e7ec2e791737 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.029840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d4829-df2d-4c02-99db-e7ec2e791737 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:14.030148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d4829-df2d-4c02-99db-e7ec2e791737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:14.032018 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d4829-df2d-4c02-99db-e7ec2e791737 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:14.041726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 464/929] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Jun 28 03:05:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:14.041726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ddd17-cfe3-46ff-9a28-e03ab18353fb None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.041726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ddd17-cfe3-46ff-9a28-e03ab18353fb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.041726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ddd17-cfe3-46ff-9a28-e03ab18353fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.059539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-391ddd17-cfe3-46ff-9a28-e03ab18353fb None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:14.060975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-391ddd17-cfe3-46ff-9a28-e03ab18353fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:14.101382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:14.106987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4105474-944d-4a27-bb04-38dcf1eee367 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:14.143629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 465/930] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:14.143819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335da6f8-1a61-48db-8441-fd649b2c9102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:14.144404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ddd17-cfe3-46ff-9a28-e03ab18353fb None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:14.144526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335da6f8-1a61-48db-8441-fd649b2c9102 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.144735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335da6f8-1a61-48db-8441-fd649b2c9102 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.145004 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335da6f8-1a61-48db-8441-fd649b2c9102 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.145793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335da6f8-1a61-48db-8441-fd649b2c9102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:14.146089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335da6f8-1a61-48db-8441-fd649b2c9102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:14.147601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335da6f8-1a61-48db-8441-fd649b2c9102 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:14.161136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 466/931] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:14.163285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335da6f8-1a61-48db-8441-fd649b2c9102 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:14.218862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:14.257553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ddd17-cfe3-46ff-9a28-e03ab18353fb None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:14.268365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335da6f8-1a61-48db-8441-fd649b2c9102 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:14.292478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f05a9-de91-4581-90a2-cd9c9ef97a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:14.293073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f05a9-de91-4581-90a2-cd9c9ef97a51 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.293354 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f05a9-de91-4581-90a2-cd9c9ef97a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.293623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f05a9-de91-4581-90a2-cd9c9ef97a51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.294384 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f05a9-de91-4581-90a2-cd9c9ef97a51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:14.295782 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f05a9-de91-4581-90a2-cd9c9ef97a51 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:14.302694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbcb6a-ef04-4457-936b-8148949eda83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:14.303499 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbcb6a-ef04-4457-936b-8148949eda83 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.303776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbcb6a-ef04-4457-936b-8148949eda83 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.304043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbcb6a-ef04-4457-936b-8148949eda83 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.304716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbcb6a-ef04-4457-936b-8148949eda83 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:14.306062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbcb6a-ef04-4457-936b-8148949eda83 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:14.316556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 466/932] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Jun 28 03:05:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:14.317508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f05a9-de91-4581-90a2-cd9c9ef97a51 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-64bbcb6a-ef04-4457-936b-8148949eda83 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:14.318914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:14.319900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:14.320765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 467/933] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Jun 28 03:05:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:14.321597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b2340-77ad-4907-9760-0fe39cb3d300 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.321668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b2340-77ad-4907-9760-0fe39cb3d300 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.321893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b2340-77ad-4907-9760-0fe39cb3d300 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.326383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 468/934] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:14.326383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b2340-77ad-4907-9760-0fe39cb3d300 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:14.355676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:14.447809 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f05a9-de91-4581-90a2-cd9c9ef97a51 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:14.448822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b2340-77ad-4907-9760-0fe39cb3d300 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:14.469043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:14.488923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b3074-6bdc-4693-8faf-2abc85993f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:14.489991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b3074-6bdc-4693-8faf-2abc85993f04 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.490258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b3074-6bdc-4693-8faf-2abc85993f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.490568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b3074-6bdc-4693-8faf-2abc85993f04 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.491303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b3074-6bdc-4693-8faf-2abc85993f04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:14.492123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b3074-6bdc-4693-8faf-2abc85993f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:14.492949 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b3074-6bdc-4693-8faf-2abc85993f04 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:14.495534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704a230-4100-4da3-91f8-12f14f4c435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:14.496556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704a230-4100-4da3-91f8-12f14f4c435d None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.496953 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704a230-4100-4da3-91f8-12f14f4c435d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.497778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704a230-4100-4da3-91f8-12f14f4c435d None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/a7d95e643b984955a20e48f71b204502/roles/421505fc5382430bb34c838f9ac50c45` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.498589 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 469/935] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Jun 28 03:05:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:14.499811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704a230-4100-4da3-91f8-12f14f4c435d None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=a7d95e643b984955a20e48f71b204502, role_id=421505fc5382430bb34c838f9ac50c45)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:14.499929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c212ab7-e1ee-4488-8208-068dd4694dad None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.500359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c212ab7-e1ee-4488-8208-068dd4694dad None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.500759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c212ab7-e1ee-4488-8208-068dd4694dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.501687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704a230-4100-4da3-91f8-12f14f4c435d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:14.518907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 467/936] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:05:14 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/a7d95e643b984955a20e48f71b204502/roles/421505fc5382430bb34c838f9ac50c45 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:05:14.519905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704a230-4100-4da3-91f8-12f14f4c435d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:14.521717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7c212ab7-e1ee-4488-8208-068dd4694dad None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:14.523972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7c212ab7-e1ee-4488-8208-068dd4694dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:14.623860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 470/937] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:14.647325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c212ab7-e1ee-4488-8208-068dd4694dad None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:14.651487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704a230-4100-4da3-91f8-12f14f4c435d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:14.669163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:14.696002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0cc04-9e8e-4269-af9a-da8d766cfa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:14.696695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0cc04-9e8e-4269-af9a-da8d766cfa83 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.696975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0cc04-9e8e-4269-af9a-da8d766cfa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.697247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0cc04-9e8e-4269-af9a-da8d766cfa83 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.697972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0cc04-9e8e-4269-af9a-da8d766cfa83 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:14.698276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0cc04-9e8e-4269-af9a-da8d766cfa83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:14.699685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0cc04-9e8e-4269-af9a-da8d766cfa83 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:14.707399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 468/938] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Jun 28 03:05:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:14.713213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0cc04-9e8e-4269-af9a-da8d766cfa83 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:14.770513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:14.788189 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c212ab7-e1ee-4488-8208-068dd4694dad None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:14.824906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf65ae9-90f7-4e5b-99b7-7469b53004a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:14.826001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65ae9-90f7-4e5b-99b7-7469b53004a2 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.826484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65ae9-90f7-4e5b-99b7-7469b53004a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.826899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65ae9-90f7-4e5b-99b7-7469b53004a2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.827702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf65ae9-90f7-4e5b-99b7-7469b53004a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:14.829298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf65ae9-90f7-4e5b-99b7-7469b53004a2 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-abf65ae9-90f7-4e5b-99b7-7469b53004a2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:14.842370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:14.843383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 03:05:14.844708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:14.846546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0cc04-9e8e-4269-af9a-da8d766cfa83 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:14.847907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 471/939] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Jun 28 03:05:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:14.854332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf65ae9-90f7-4e5b-99b7-7469b53004a2 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:14.890529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1bc2f-3921-47c8-aae7-4382a67ccf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:14.891940 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1bc2f-3921-47c8-aae7-4382a67ccf0f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:14.892218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1bc2f-3921-47c8-aae7-4382a67ccf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:14.892491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1bc2f-3921-47c8-aae7-4382a67ccf0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:14.893347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1bc2f-3921-47c8-aae7-4382a67ccf0f None admin] RBAC: Adding query filter params (interface=public, service_id=105d9bdcc10a48d1abf5feb6eb2807dd, region_id=RegionOne) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:14.893661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1bc2f-3921-47c8-aae7-4382a67ccf0f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:14.895052 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1bc2f-3921-47c8-aae7-4382a67ccf0f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:14.901210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 469/940] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Jun 28 03:05:14 2022] GET /identity/v3/endpoints?service_id=105d9bdcc10a48d1abf5feb6eb2807dd&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:14.908325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1bc2f-3921-47c8-aae7-4382a67ccf0f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:14.943556 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:14.967958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf65ae9-90f7-4e5b-99b7-7469b53004a2 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:15.004549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabb974-2aec-4030-ae49-e04032ba461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:15.005225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb974-2aec-4030-ae49-e04032ba461b None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:15.005505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb974-2aec-4030-ae49-e04032ba461b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:15.005774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb974-2aec-4030-ae49-e04032ba461b None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:15.006508 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabb974-2aec-4030-ae49-e04032ba461b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:15.006810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabb974-2aec-4030-ae49-e04032ba461b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:15.008394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabb974-2aec-4030-ae49-e04032ba461b None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:15.013890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 472/941] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Jun 28 03:05:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:15.019481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabb974-2aec-4030-ae49-e04032ba461b None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:15.025447 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1bc2f-3921-47c8-aae7-4382a67ccf0f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:15.028076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:15.067177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924924e-5675-4384-8c36-0280992874b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:15.068008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924924e-5675-4384-8c36-0280992874b9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:15.068286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924924e-5675-4384-8c36-0280992874b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:15.068553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924924e-5675-4384-8c36-0280992874b9 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:15.069543 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924924e-5675-4384-8c36-0280992874b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:15.071208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924924e-5675-4384-8c36-0280992874b9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:15.082349 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 470/942] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Jun 28 03:05:14 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:05:15.154623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabb974-2aec-4030-ae49-e04032ba461b None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:15.193752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653e8b6-5302-4b55-9f63-df327d385ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:15.194480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e8b6-5302-4b55-9f63-df327d385ecc None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:15.194762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e8b6-5302-4b55-9f63-df327d385ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:15.195034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e8b6-5302-4b55-9f63-df327d385ecc None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:15.195760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653e8b6-5302-4b55-9f63-df327d385ecc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:15.196064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653e8b6-5302-4b55-9f63-df327d385ecc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:15.197473 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653e8b6-5302-4b55-9f63-df327d385ecc None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:15.203337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 473/943] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Jun 28 03:05:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:15.209368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924924e-5675-4384-8c36-0280992874b9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:15.325034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924924e-5675-4384-8c36-0280992874b9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:15.360722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7714063-d576-4d5f-8fab-7fbb789abcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:15.361805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7714063-d576-4d5f-8fab-7fbb789abcad None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:15.362279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7714063-d576-4d5f-8fab-7fbb789abcad None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:15.362764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7714063-d576-4d5f-8fab-7fbb789abcad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:15.363687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7714063-d576-4d5f-8fab-7fbb789abcad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:15.365634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7714063-d576-4d5f-8fab-7fbb789abcad None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:15.385970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 471/944] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Jun 28 03:05:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:16.465051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7177fb-287b-48be-a748-d96e74c05886 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:16.465609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7177fb-287b-48be-a748-d96e74c05886 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:16.465609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7177fb-287b-48be-a748-d96e74c05886 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:16.467306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 474/945] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:16.472713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426550d-42e5-4041-9600-ae51a2dd6eeb None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:16.473108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426550d-42e5-4041-9600-ae51a2dd6eeb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:16.473282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426550d-42e5-4041-9600-ae51a2dd6eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:16.490469 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4426550d-42e5-4041-9600-ae51a2dd6eeb None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:16.491651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4426550d-42e5-4041-9600-ae51a2dd6eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:16.513101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:16.571677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 472/946] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:16.595153 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7177fb-287b-48be-a748-d96e74c05886 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:16.599228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:16.683804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a95d0-a62b-45f0-af47-600301e16b5c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:16.684284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a95d0-a62b-45f0-af47-600301e16b5c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:16.684755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a95d0-a62b-45f0-af47-600301e16b5c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:16.693372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 473/947] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:16.695406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deac0f1-ecfd-476f-a631-4d53feb4da00 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:16.695763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deac0f1-ecfd-476f-a631-4d53feb4da00 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:16.696104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deac0f1-ecfd-476f-a631-4d53feb4da00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:16.707620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7177fb-287b-48be-a748-d96e74c05886 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:16.715349 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5deac0f1-ecfd-476f-a631-4d53feb4da00 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:16.716473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5deac0f1-ecfd-476f-a631-4d53feb4da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:16.749630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b543042-159b-4fb0-8ae1-232f5f931273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:16.751035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b543042-159b-4fb0-8ae1-232f5f931273 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:16.751317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b543042-159b-4fb0-8ae1-232f5f931273 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:16.751582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b543042-159b-4fb0-8ae1-232f5f931273 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:16.752291 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b543042-159b-4fb0-8ae1-232f5f931273 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:16.753988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b543042-159b-4fb0-8ae1-232f5f931273 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:16.755456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: WARNING keystone.server.flask.common [None req-4b543042-159b-4fb0-8ae1-232f5f931273 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 28 03:05:16.775431 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.sql.core [None req-4b543042-159b-4fb0-8ae1-232f5f931273 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 28 03:05:16.775431 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 28 03:05:16.775431 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [parameters: {'id': '9df62b990e0e4bbab6b483277d935d60', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 28 03:05:16.775431 dv-cinder-846842-5-smb devstack@keystone.service[80342]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80342) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-4b543042-159b-4fb0-8ae1-232f5f931273 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9df62b990e0e4bbab6b483277d935d60.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9df62b990e0e4bbab6b483277d935d60. Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application conn.query(q) Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 03:05:16.786195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result.read() Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 28 03:05:16.787213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application next(self.gen) Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application yield resource Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application next(self.gen) Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.session.rollback() Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.force_reraise() Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise self.value Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application session.commit() Jun 28 03:05:16.788542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._prepare_impl() Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.session.flush() Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._flush(objects) Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application compat.raise_( Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application flush_context.execute() Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 28 03:05:16.794819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rec.execute(self) Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 28 03:05:16.797350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application conn.query(q) Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result.read() Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 03:05:16.799205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [parameters: {'id': '9df62b990e0e4bbab6b483277d935d60', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:16.801569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:16.803565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:16.805782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:16.805782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 28 03:05:16.805782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 28 03:05:16.805782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:16.805782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:16.805782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 28 03:05:16.805782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 28 03:05:16.805782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9df62b990e0e4bbab6b483277d935d60. Jun 28 03:05:16.805782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:16.805782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 475/948] 10.222.0.23 () {60 vars in 1140 bytes} [Tue Jun 28 03:05:16 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:16.805782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b543042-159b-4fb0-8ae1-232f5f931273 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:16.808202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 474/949] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:16.830334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deac0f1-ecfd-476f-a631-4d53feb4da00 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:16.868849 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:16.914224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b543042-159b-4fb0-8ae1-232f5f931273 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:16.922959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:16.944409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deac0f1-ecfd-476f-a631-4d53feb4da00 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:16.952593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb45172-98d2-4b4f-b673-b0e39ff1343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:16.953737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb45172-98d2-4b4f-b673-b0e39ff1343e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:16.954190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb45172-98d2-4b4f-b673-b0e39ff1343e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:16.954730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb45172-98d2-4b4f-b673-b0e39ff1343e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:16.963235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb45172-98d2-4b4f-b673-b0e39ff1343e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:16.965130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb45172-98d2-4b4f-b673-b0e39ff1343e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:16.980744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fadc23-0b4d-4d07-ad00-7f029cfe506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:16.981497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fadc23-0b4d-4d07-ad00-7f029cfe506b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:16.981774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fadc23-0b4d-4d07-ad00-7f029cfe506b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:16.982042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fadc23-0b4d-4d07-ad00-7f029cfe506b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-4fb45172-98d2-4b4f-b673-b0e39ff1343e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:05:16.982883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:16.984028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:16.985298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:05:16.985298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:05:16.985298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:05:16.985298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:05:16.985298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:05:16.985298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:05:16.985298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:16.985298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:16.987615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 476/950] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:16.993233 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb45172-98d2-4b4f-b673-b0e39ff1343e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:16.993652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fadc23-0b4d-4d07-ad00-7f029cfe506b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-33fadc23-0b4d-4d07-ad00-7f029cfe506b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:17.003174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:17.004157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:17.005619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 475/951] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Jun 28 03:05:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:17.010470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fadc23-0b4d-4d07-ad00-7f029cfe506b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:17.115761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb45172-98d2-4b4f-b673-b0e39ff1343e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:17.121673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fadc23-0b4d-4d07-ad00-7f029cfe506b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:17.139039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:17.157061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afde59b-9378-4dfa-9477-e50fea97931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:17.157743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee65f9b-2af5-420e-84c5-fa98c33d335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:17.158334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde59b-9378-4dfa-9477-e50fea97931b None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.158470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65f9b-2af5-420e-84c5-fa98c33d335b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.158740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65f9b-2af5-420e-84c5-fa98c33d335b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.159010 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65f9b-2af5-420e-84c5-fa98c33d335b None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.159380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde59b-9378-4dfa-9477-e50fea97931b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.159763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee65f9b-2af5-420e-84c5-fa98c33d335b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:17.160066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee65f9b-2af5-420e-84c5-fa98c33d335b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:17.160168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde59b-9378-4dfa-9477-e50fea97931b None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.161121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afde59b-9378-4dfa-9477-e50fea97931b None admin] RBAC: Adding query filter params (name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:17.161440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee65f9b-2af5-420e-84c5-fa98c33d335b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:17.161837 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afde59b-9378-4dfa-9477-e50fea97931b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:17.163693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afde59b-9378-4dfa-9477-e50fea97931b None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:17.170329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 476/952] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Jun 28 03:05:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:17.175877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee65f9b-2af5-420e-84c5-fa98c33d335b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:17.178694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:17.198830 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 477/953] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:05:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:17.254790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450c718-c0b4-42f6-b86c-c737cd25be66 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.255134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450c718-c0b4-42f6-b86c-c737cd25be66 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.255580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450c718-c0b4-42f6-b86c-c737cd25be66 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.257487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 478/954] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:05:17.263420 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdec771-4945-4441-bcaa-a07818a99181 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.264022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdec771-4945-4441-bcaa-a07818a99181 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.264527 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdec771-4945-4441-bcaa-a07818a99181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.286653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-dbdec771-4945-4441-bcaa-a07818a99181 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:17.289647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-dbdec771-4945-4441-bcaa-a07818a99181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:17.294215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee65f9b-2af5-420e-84c5-fa98c33d335b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:17.337449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80c809-7b83-4e01-bdfe-9b076d7b7cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:17.338649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80c809-7b83-4e01-bdfe-9b076d7b7cdf None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.339175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80c809-7b83-4e01-bdfe-9b076d7b7cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.339709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80c809-7b83-4e01-bdfe-9b076d7b7cdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.353366 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80c809-7b83-4e01-bdfe-9b076d7b7cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:17.355289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80c809-7b83-4e01-bdfe-9b076d7b7cdf None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-6f80c809-7b83-4e01-bdfe-9b076d7b7cdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:17.377587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:17.378676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:17.379598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:17.379598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:17.379598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:17.379598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:17.380263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 477/955] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:17.381891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 479/956] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:17.391338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80c809-7b83-4e01-bdfe-9b076d7b7cdf None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:17.409361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdec771-4945-4441-bcaa-a07818a99181 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:17.455585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:17.522941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80c809-7b83-4e01-bdfe-9b076d7b7cdf None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:17.524087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdec771-4945-4441-bcaa-a07818a99181 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:17.543048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:17.563911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226f7d4-3ab5-4f3c-8c96-e63a5116986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:17.564752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226f7d4-3ab5-4f3c-8c96-e63a5116986c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.565033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226f7d4-3ab5-4f3c-8c96-e63a5116986c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.565297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226f7d4-3ab5-4f3c-8c96-e63a5116986c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.565953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226f7d4-3ab5-4f3c-8c96-e63a5116986c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:17.566398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51410f9e-3a24-4810-a50a-8a8c1e6831bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:17.567080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51410f9e-3a24-4810-a50a-8a8c1e6831bf None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.567364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51410f9e-3a24-4810-a50a-8a8c1e6831bf None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.567457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226f7d4-3ab5-4f3c-8c96-e63a5116986c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:17.567639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51410f9e-3a24-4810-a50a-8a8c1e6831bf None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.568369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51410f9e-3a24-4810-a50a-8a8c1e6831bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:17.568688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51410f9e-3a24-4810-a50a-8a8c1e6831bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:17.570031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51410f9e-3a24-4810-a50a-8a8c1e6831bf None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-1226f7d4-3ab5-4f3c-8c96-e63a5116986c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:17.581360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:17.582496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:17.588361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 480/957] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Jun 28 03:05:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:17.589175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 478/958] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:17.589249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5088b-df36-4d19-a5b4-d328cb433a55 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.589336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51410f9e-3a24-4810-a50a-8a8c1e6831bf None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:17.589415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5088b-df36-4d19-a5b4-d328cb433a55 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.589415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5088b-df36-4d19-a5b4-d328cb433a55 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.590877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 481/959] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:17.591511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5088b-df36-4d19-a5b4-d328cb433a55 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:17.701413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51410f9e-3a24-4810-a50a-8a8c1e6831bf None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:17.705836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5088b-df36-4d19-a5b4-d328cb433a55 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:17.716098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:17.740373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75356-1ea2-4dc3-8a48-be9653309291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:17.741047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75356-1ea2-4dc3-8a48-be9653309291 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.741432 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75356-1ea2-4dc3-8a48-be9653309291 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.741709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75356-1ea2-4dc3-8a48-be9653309291 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.742451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75356-1ea2-4dc3-8a48-be9653309291 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:17.742756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75356-1ea2-4dc3-8a48-be9653309291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:17.744123 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75356-1ea2-4dc3-8a48-be9653309291 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:17.748949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 479/960] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Jun 28 03:05:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:17.750222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51100558-ffd7-44c8-b3c9-105ea8b7f9d1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.750529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51100558-ffd7-44c8-b3c9-105ea8b7f9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.750892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51100558-ffd7-44c8-b3c9-105ea8b7f9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.755738 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d68c67-29e0-4a2a-b9d8-775e19b0b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:17.756834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d68c67-29e0-4a2a-b9d8-775e19b0b31e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.757340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d68c67-29e0-4a2a-b9d8-775e19b0b31e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.757711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d68c67-29e0-4a2a-b9d8-775e19b0b31e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.767581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d68c67-29e0-4a2a-b9d8-775e19b0b31e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:17.769166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d68c67-29e0-4a2a-b9d8-775e19b0b31e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:17.770054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-51100558-ffd7-44c8-b3c9-105ea8b7f9d1 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:17.771284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-51100558-ffd7-44c8-b3c9-105ea8b7f9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-e8d68c67-29e0-4a2a-b9d8-775e19b0b31e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:05:17.787913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:17.788898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 482/961] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Jun 28 03:05:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:17.789860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d68c67-29e0-4a2a-b9d8-775e19b0b31e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:17.826728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:17.854459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 480/962] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:17.854459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51100558-ffd7-44c8-b3c9-105ea8b7f9d1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:17.900313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d68c67-29e0-4a2a-b9d8-775e19b0b31e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:17.936556 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd82f1-246c-4965-9f8f-4130144a8627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:17.937235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd82f1-246c-4965-9f8f-4130144a8627 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:17.937580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd82f1-246c-4965-9f8f-4130144a8627 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:17.937858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd82f1-246c-4965-9f8f-4130144a8627 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:17.938627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd82f1-246c-4965-9f8f-4130144a8627 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:17.938934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd82f1-246c-4965-9f8f-4130144a8627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:17.940310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd82f1-246c-4965-9f8f-4130144a8627 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:17.950143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 483/963] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Jun 28 03:05:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:17.950143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd82f1-246c-4965-9f8f-4130144a8627 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:17.970017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51100558-ffd7-44c8-b3c9-105ea8b7f9d1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:17.980523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:18.011610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ead597-3250-4050-9a19-899f7f38175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:18.012592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ead597-3250-4050-9a19-899f7f38175f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:18.013048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ead597-3250-4050-9a19-899f7f38175f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:18.013396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ead597-3250-4050-9a19-899f7f38175f None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:18.014170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ead597-3250-4050-9a19-899f7f38175f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:18.014503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ead597-3250-4050-9a19-899f7f38175f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:18.016048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ead597-3250-4050-9a19-899f7f38175f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:18.036218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 481/964] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Jun 28 03:05:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:18.038138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ead597-3250-4050-9a19-899f7f38175f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:18.055831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:18.063096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd82f1-246c-4965-9f8f-4130144a8627 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:18.102362 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da28f77-d434-46bf-adc9-81069ee68c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:18.103286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da28f77-d434-46bf-adc9-81069ee68c0a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:18.103631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da28f77-d434-46bf-adc9-81069ee68c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:18.103911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da28f77-d434-46bf-adc9-81069ee68c0a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:18.104570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da28f77-d434-46bf-adc9-81069ee68c0a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:18.105940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da28f77-d434-46bf-adc9-81069ee68c0a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-9da28f77-d434-46bf-adc9-81069ee68c0a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:18.118150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:18.119374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:18.120232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 484/965] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:18.121040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da28f77-d434-46bf-adc9-81069ee68c0a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:18.167770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ead597-3250-4050-9a19-899f7f38175f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:18.203454 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c334647-f669-4743-8a2e-f26ea66dab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:18.204135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334647-f669-4743-8a2e-f26ea66dab39 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:18.204421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334647-f669-4743-8a2e-f26ea66dab39 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:18.204696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334647-f669-4743-8a2e-f26ea66dab39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:18.205442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c334647-f669-4743-8a2e-f26ea66dab39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:18.206921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c334647-f669-4743-8a2e-f26ea66dab39 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:18.226208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 482/966] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Jun 28 03:05:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:18.227044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c334647-f669-4743-8a2e-f26ea66dab39 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:18.243484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da28f77-d434-46bf-adc9-81069ee68c0a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:18.255475 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:18.306923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b11270-7ccf-4283-b8f8-7c2303f61ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:18.307511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b11270-7ccf-4283-b8f8-7c2303f61ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:18.307796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b11270-7ccf-4283-b8f8-7c2303f61ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:18.308086 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b11270-7ccf-4283-b8f8-7c2303f61ec9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:18.351462 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:18.351666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c334647-f669-4743-8a2e-f26ea66dab39 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:18.393145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366db232-e4c5-4051-ab38-8858e2951187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:18.393851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366db232-e4c5-4051-ab38-8858e2951187 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:18.394150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366db232-e4c5-4051-ab38-8858e2951187 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:18.394450 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366db232-e4c5-4051-ab38-8858e2951187 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:18.395185 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366db232-e4c5-4051-ab38-8858e2951187 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:18.395491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366db232-e4c5-4051-ab38-8858e2951187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:18.396907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366db232-e4c5-4051-ab38-8858e2951187 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:18.407489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 483/967] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:05:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:18.408892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366db232-e4c5-4051-ab38-8858e2951187 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:18.418694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b11270-7ccf-4283-b8f8-7c2303f61ec9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:18.421033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b11270-7ccf-4283-b8f8-7c2303f61ec9 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:18.541784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 485/968] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:18 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:05:18.547323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366db232-e4c5-4051-ab38-8858e2951187 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:18.547323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:18.548298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b11270-7ccf-4283-b8f8-7c2303f61ec9 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:18.593336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c02ac-deee-4a8d-bd54-769e16846cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:18.595102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c02ac-deee-4a8d-bd54-769e16846cea None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:18.595590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c02ac-deee-4a8d-bd54-769e16846cea None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:18.596112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c02ac-deee-4a8d-bd54-769e16846cea None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:18.597675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c02ac-deee-4a8d-bd54-769e16846cea None admin] RBAC: Adding query filter params (type=compute) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:18.598182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c02ac-deee-4a8d-bd54-769e16846cea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:18.600529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c02ac-deee-4a8d-bd54-769e16846cea None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:18.608769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 484/969] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:05:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:18.615834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:18.663565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b11270-7ccf-4283-b8f8-7c2303f61ec9 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:18.702458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b4e9-cc82-4ddf-9cc5-6b681884ea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:18.703913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b4e9-cc82-4ddf-9cc5-6b681884ea9c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:18.704462 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b4e9-cc82-4ddf-9cc5-6b681884ea9c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:18.704962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b4e9-cc82-4ddf-9cc5-6b681884ea9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:18.723238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3b4e9-cc82-4ddf-9cc5-6b681884ea9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:18.725113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3b4e9-cc82-4ddf-9cc5-6b681884ea9c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-2db3b4e9-cc82-4ddf-9cc5-6b681884ea9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:18.746522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:18.747518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:18.748415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:18.748415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:18.748415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:18.748415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:18.751044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 486/970] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:18.759507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c02ac-deee-4a8d-bd54-769e16846cea None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:18.880043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c02ac-deee-4a8d-bd54-769e16846cea None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:18.914536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234cbc1-b855-4e48-ba79-3474ac3db0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:18.915619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cbc1-b855-4e48-ba79-3474ac3db0fa None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:18.916111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cbc1-b855-4e48-ba79-3474ac3db0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:18.916575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cbc1-b855-4e48-ba79-3474ac3db0fa None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:18.917488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234cbc1-b855-4e48-ba79-3474ac3db0fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:18.918003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234cbc1-b855-4e48-ba79-3474ac3db0fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:18.919589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234cbc1-b855-4e48-ba79-3474ac3db0fa None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:18.932849 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 485/971] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:18.938944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b4e9-cc82-4ddf-9cc5-6b681884ea9c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:19.043044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b4e9-cc82-4ddf-9cc5-6b681884ea9c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:19.055036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:19.085723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85e913-97bd-4a37-ae84-844ae8fd9155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:19.086598 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85e913-97bd-4a37-ae84-844ae8fd9155 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:19.086979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85e913-97bd-4a37-ae84-844ae8fd9155 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:19.087447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85e913-97bd-4a37-ae84-844ae8fd9155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:19.096079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85e913-97bd-4a37-ae84-844ae8fd9155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:19.097549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85e913-97bd-4a37-ae84-844ae8fd9155 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-0c85e913-97bd-4a37-ae84-844ae8fd9155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:05:19.112002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:19.112936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:19.113840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:05:19.113840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:05:19.113840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:05:19.113840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:05:19.113840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:05:19.113840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:05:19.113840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:19.113840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:19.115167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 487/972] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:19.120714 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234cbc1-b855-4e48-ba79-3474ac3db0fa None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:19.134251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:19.235509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234cbc1-b855-4e48-ba79-3474ac3db0fa None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:19.271487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111fb7c-253c-45c2-8ba7-02561cd0c300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:19.272165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111fb7c-253c-45c2-8ba7-02561cd0c300 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:19.272444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111fb7c-253c-45c2-8ba7-02561cd0c300 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:19.272714 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111fb7c-253c-45c2-8ba7-02561cd0c300 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:19.273510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111fb7c-253c-45c2-8ba7-02561cd0c300 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:19.273831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111fb7c-253c-45c2-8ba7-02561cd0c300 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:19.275286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111fb7c-253c-45c2-8ba7-02561cd0c300 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:19.287586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 486/973] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:19.293548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85e913-97bd-4a37-ae84-844ae8fd9155 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:19.397311 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85e913-97bd-4a37-ae84-844ae8fd9155 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:19.405212 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506aa12-85b2-4b8a-aecb-534c8edf0184 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:19.405497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506aa12-85b2-4b8a-aecb-534c8edf0184 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:19.405772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506aa12-85b2-4b8a-aecb-534c8edf0184 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:19.407868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 487/974] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:19.412916 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7710b-f251-4195-be13-22386dd561a7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:19.413199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7710b-f251-4195-be13-22386dd561a7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:19.413473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7710b-f251-4195-be13-22386dd561a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:19.431136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-51b7710b-f251-4195-be13-22386dd561a7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:19.432307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-51b7710b-f251-4195-be13-22386dd561a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:19.434027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1a5f8-c4b9-43cc-be1d-7798ed00d9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:19.435830 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1a5f8-c4b9-43cc-be1d-7798ed00d9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:19.436132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1a5f8-c4b9-43cc-be1d-7798ed00d9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:19.436408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1a5f8-c4b9-43cc-be1d-7798ed00d9f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:19.437255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1a5f8-c4b9-43cc-be1d-7798ed00d9f9 None admin] RBAC: Adding query filter params (role.id=421505fc5382430bb34c838f9ac50c45, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=a7d95e643b984955a20e48f71b204502) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:19.437908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1a5f8-c4b9-43cc-be1d-7798ed00d9f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:19.439574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1a5f8-c4b9-43cc-be1d-7798ed00d9f9 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:19.448847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 488/975] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:19 2022] GET /identity/v3/role_assignments?user.id=a7d95e643b984955a20e48f71b204502&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=421505fc5382430bb34c838f9ac50c45 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:19.512592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:19.522655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 488/976] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:19.544408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1a5f8-c4b9-43cc-be1d-7798ed00d9f9 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:19.582445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:19.654121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1a5f8-c4b9-43cc-be1d-7798ed00d9f9 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:19.691250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c33c-8ff9-4709-bec4-22a43d7c05bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:19.691987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c33c-8ff9-4709-bec4-22a43d7c05bf None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:19.692260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c33c-8ff9-4709-bec4-22a43d7c05bf None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:19.692530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c33c-8ff9-4709-bec4-22a43d7c05bf None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:19.693295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c33c-8ff9-4709-bec4-22a43d7c05bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:19.694778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c33c-8ff9-4709-bec4-22a43d7c05bf None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:19.708640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.sql.core [None req-e1a5c33c-8ff9-4709-bec4-22a43d7c05bf None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 28 03:05:19.708640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 28 03:05:19.708640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [parameters: {'user_id': '20866dd6a93e484b850585294afdf862', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 28 03:05:19.708640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80342) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-e1a5c33c-8ff9-4709-bec4-22a43d7c05bf None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application conn.query(q) Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result.read() Jun 28 03:05:19.716067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 03:05:19.716956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application next(self.gen) Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application yield resource Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application next(self.gen) Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.session.rollback() Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.force_reraise() Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise self.value Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application session.commit() Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 28 03:05:19.717948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._prepare_impl() Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.session.flush() Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._flush(objects) Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application compat.raise_( Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application flush_context.execute() Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rec.execute(self) Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 28 03:05:19.718978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 03:05:19.719887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application conn.query(q) Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application result.read() Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 03:05:19.720744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [parameters: {'user_id': '20866dd6a93e484b850585294afdf862', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:19.721588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 28 03:05:19.723697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 28 03:05:19.725813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 28 03:05:19.725813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 28 03:05:19.725813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 28 03:05:19.725813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 28 03:05:19.725813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 28 03:05:19.725813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:19.725813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 489/977] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Jun 28 03:05:19 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:19.727475 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7710b-f251-4195-be13-22386dd561a7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:19.834415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7710b-f251-4195-be13-22386dd561a7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:19.870106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c85abe-e387-4da4-86fe-eef6f02af2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:19.871308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c85abe-e387-4da4-86fe-eef6f02af2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:19.871733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c85abe-e387-4da4-86fe-eef6f02af2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:19.872143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c85abe-e387-4da4-86fe-eef6f02af2d4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:19.880580 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c85abe-e387-4da4-86fe-eef6f02af2d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:19.882336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c85abe-e387-4da4-86fe-eef6f02af2d4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a3c85abe-e387-4da4-86fe-eef6f02af2d4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:05:19.897556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:19.898823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:19.900009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:19.900009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:19.900009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:05:19.900009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:05:19.900009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:05:19.900009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:05:19.900009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:05:19.900009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:05:19.900009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 03:05:19.900009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:19.902329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 489/978] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:05:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:19.913438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c33c-8ff9-4709-bec4-22a43d7c05bf None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:20.014893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:20.021868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c33c-8ff9-4709-bec4-22a43d7c05bf None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:20.065266 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b647d-c928-476a-80c6-14d061506c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:20.065969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b647d-c928-476a-80c6-14d061506c92 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:20.066246 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b647d-c928-476a-80c6-14d061506c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:20.066545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b647d-c928-476a-80c6-14d061506c92 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:20.067363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b647d-c928-476a-80c6-14d061506c92 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:20.067664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b647d-c928-476a-80c6-14d061506c92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:20.069300 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b647d-c928-476a-80c6-14d061506c92 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:20.107991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 490/979] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Jun 28 03:05:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:20.422812 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15f8bf-45d9-4fb7-9bbc-d0ca2c8de545 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:20.423068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15f8bf-45d9-4fb7-9bbc-d0ca2c8de545 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:20.423505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15f8bf-45d9-4fb7-9bbc-d0ca2c8de545 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:20.424947 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 490/980] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:20.430785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57708b-7198-4c0e-bade-088d6a9fb2eb None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:20.431043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57708b-7198-4c0e-bade-088d6a9fb2eb None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:20.431359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57708b-7198-4c0e-bade-088d6a9fb2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:20.449643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-fe57708b-7198-4c0e-bade-088d6a9fb2eb None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:20.451178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fe57708b-7198-4c0e-bade-088d6a9fb2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:20.521508 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 491/981] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:20.544920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15f8bf-45d9-4fb7-9bbc-d0ca2c8de545 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:20.613110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:20.659230 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15f8bf-45d9-4fb7-9bbc-d0ca2c8de545 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:20.695935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33505e-4b24-4d2d-a749-1693b1d3fbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:20.697132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33505e-4b24-4d2d-a749-1693b1d3fbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:20.697605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33505e-4b24-4d2d-a749-1693b1d3fbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:20.698066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33505e-4b24-4d2d-a749-1693b1d3fbd4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:20.698987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33505e-4b24-4d2d-a749-1693b1d3fbd4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:20.700671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33505e-4b24-4d2d-a749-1693b1d3fbd4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-4e33505e-4b24-4d2d-a749-1693b1d3fbd4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:20.714983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:20.716045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:20.716888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:20.717952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 491/982] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Jun 28 03:05:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:20.725238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57708b-7198-4c0e-bade-088d6a9fb2eb None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:20.744993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dba382-3ea0-4f93-95c6-e061d7a2c901 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:20.745490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dba382-3ea0-4f93-95c6-e061d7a2c901 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:20.745568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dba382-3ea0-4f93-95c6-e061d7a2c901 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:20.747332 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 492/983] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:20.752188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1644d8-9f13-4bd0-be2a-ccee2e81d478 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:20.752509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1644d8-9f13-4bd0-be2a-ccee2e81d478 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:20.752741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1644d8-9f13-4bd0-be2a-ccee2e81d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:20.769746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3a1644d8-9f13-4bd0-be2a-ccee2e81d478 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:20.770967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3a1644d8-9f13-4bd0-be2a-ccee2e81d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:20.814577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:20.831779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57708b-7198-4c0e-bade-088d6a9fb2eb None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:20.843182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 493/984] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:20.865349 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1644d8-9f13-4bd0-be2a-ccee2e81d478 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:20.872282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744964d-a4cf-454c-a0da-803778a4ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:20.872966 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744964d-a4cf-454c-a0da-803778a4ca81 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:20.873324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744964d-a4cf-454c-a0da-803778a4ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:20.873603 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744964d-a4cf-454c-a0da-803778a4ca81 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:20.874374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744964d-a4cf-454c-a0da-803778a4ca81 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:20.874684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744964d-a4cf-454c-a0da-803778a4ca81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:20.876234 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744964d-a4cf-454c-a0da-803778a4ca81 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:20.881515 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 492/985] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Jun 28 03:05:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:20.887030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744964d-a4cf-454c-a0da-803778a4ca81 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:20.922185 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:20.969490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1644d8-9f13-4bd0-be2a-ccee2e81d478 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:20.991722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744964d-a4cf-454c-a0da-803778a4ca81 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:21.004334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2886bc-a9b6-45e9-82b9-3849ca70ec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:21.005114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2886bc-a9b6-45e9-82b9-3849ca70ec78 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:21.005390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2886bc-a9b6-45e9-82b9-3849ca70ec78 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:21.005662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2886bc-a9b6-45e9-82b9-3849ca70ec78 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:21.006414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2886bc-a9b6-45e9-82b9-3849ca70ec78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:21.007789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2886bc-a9b6-45e9-82b9-3849ca70ec78 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:21.022546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 494/986] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:05:20 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:21.039334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9852937-3bfe-4419-8798-2938e008d713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:21.040377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852937-3bfe-4419-8798-2938e008d713 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:21.040606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852937-3bfe-4419-8798-2938e008d713 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:21.041034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852937-3bfe-4419-8798-2938e008d713 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:21.041824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9852937-3bfe-4419-8798-2938e008d713 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:21.042495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9852937-3bfe-4419-8798-2938e008d713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:21.046007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9852937-3bfe-4419-8798-2938e008d713 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:21.057986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 493/987] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Jun 28 03:05:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:21.059786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2886bc-a9b6-45e9-82b9-3849ca70ec78 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:21.199379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2886bc-a9b6-45e9-82b9-3849ca70ec78 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:21.215081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:21.241927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10db1d7-4250-4abb-85c2-e6c84d24d483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:21.242606 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10db1d7-4250-4abb-85c2-e6c84d24d483 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:21.242887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10db1d7-4250-4abb-85c2-e6c84d24d483 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:21.243161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10db1d7-4250-4abb-85c2-e6c84d24d483 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:21.243977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10db1d7-4250-4abb-85c2-e6c84d24d483 None admin] RBAC: Adding query filter params (interface=admin, service_id=105d9bdcc10a48d1abf5feb6eb2807dd, region_id=RegionOne) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:21.244294 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10db1d7-4250-4abb-85c2-e6c84d24d483 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:21.245695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10db1d7-4250-4abb-85c2-e6c84d24d483 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:21.256686 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 495/988] 10.222.0.23 () {56 vars in 1249 bytes} [Tue Jun 28 03:05:21 2022] GET /identity/v3/endpoints?service_id=105d9bdcc10a48d1abf5feb6eb2807dd&interface=admin®ion_id=RegionOne => generated 193 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:21.258263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9852937-3bfe-4419-8798-2938e008d713 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:21.271670 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:21.362401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9852937-3bfe-4419-8798-2938e008d713 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:21.397697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b3334-59fc-49e2-b554-becc4709b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:21.398409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3334-59fc-49e2-b554-becc4709b068 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:21.398686 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3334-59fc-49e2-b554-becc4709b068 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:21.398954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3334-59fc-49e2-b554-becc4709b068 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:21.399638 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b3334-59fc-49e2-b554-becc4709b068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:21.401061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b3334-59fc-49e2-b554-becc4709b068 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:21.414339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 494/989] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Jun 28 03:05:21 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:05:21.669834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445a247-0340-4eb9-89e5-811a6bc0ba84 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:21.670247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445a247-0340-4eb9-89e5-811a6bc0ba84 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:21.670374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445a247-0340-4eb9-89e5-811a6bc0ba84 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:21.672014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 496/990] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:21.677613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d321a8-6d29-4380-bf68-cd6b2940bf2b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:21.677864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d321a8-6d29-4380-bf68-cd6b2940bf2b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:21.678169 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d321a8-6d29-4380-bf68-cd6b2940bf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:21.696837 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f7d321a8-6d29-4380-bf68-cd6b2940bf2b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:21.698014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f7d321a8-6d29-4380-bf68-cd6b2940bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:21.774335 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 495/991] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:21.792508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445a247-0340-4eb9-89e5-811a6bc0ba84 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:21.901638 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445a247-0340-4eb9-89e5-811a6bc0ba84 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:21.936642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a080f3-fb09-4c29-b846-273a97e6713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:21.937446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a080f3-fb09-4c29-b846-273a97e6713d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:21.938196 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a080f3-fb09-4c29-b846-273a97e6713d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:21.938507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a080f3-fb09-4c29-b846-273a97e6713d None admin] PATH_INFO: `/v3/services/image` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:21.939153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a080f3-fb09-4c29-b846-273a97e6713d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:21.940539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a080f3-fb09-4c29-b846-273a97e6713d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c4a080f3-fb09-4c29-b846-273a97e6713d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:21.952107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:21.953176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 03:05:21.954037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:21.958684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 497/992] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Jun 28 03:05:21 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:21.959721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d321a8-6d29-4380-bf68-cd6b2940bf2b None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:21.961952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:22.068831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d321a8-6d29-4380-bf68-cd6b2940bf2b None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:22.104435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658df609-6cc6-4189-9c34-3423a29330bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:22.105108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df609-6cc6-4189-9c34-3423a29330bd None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:22.105345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df609-6cc6-4189-9c34-3423a29330bd None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:22.105641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df609-6cc6-4189-9c34-3423a29330bd None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:22.106388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658df609-6cc6-4189-9c34-3423a29330bd None admin] RBAC: Adding query filter params (name=image) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:22.106634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658df609-6cc6-4189-9c34-3423a29330bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:22.108013 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658df609-6cc6-4189-9c34-3423a29330bd None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:22.114140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 496/993] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:22.120121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a080f3-fb09-4c29-b846-273a97e6713d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:22.165918 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:22.232062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a080f3-fb09-4c29-b846-273a97e6713d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:22.270725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0355a-5be5-42d6-a1a0-8f8c979bda75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:22.271407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0355a-5be5-42d6-a1a0-8f8c979bda75 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:22.271685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0355a-5be5-42d6-a1a0-8f8c979bda75 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:22.271961 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0355a-5be5-42d6-a1a0-8f8c979bda75 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:22.272672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0355a-5be5-42d6-a1a0-8f8c979bda75 None admin] RBAC: Adding query filter params (type=image) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:22.272975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0355a-5be5-42d6-a1a0-8f8c979bda75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:22.274391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0355a-5be5-42d6-a1a0-8f8c979bda75 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:22.279220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 498/994] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:23.137648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b400b-2e54-4fcb-bb7e-6712815ed70e None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:23.138187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b400b-2e54-4fcb-bb7e-6712815ed70e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:23.138187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b400b-2e54-4fcb-bb7e-6712815ed70e None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:23.139787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 497/995] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:23.145263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808561-aa76-4165-846b-295e38fc68bd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:23.145677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808561-aa76-4165-846b-295e38fc68bd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:23.145847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808561-aa76-4165-846b-295e38fc68bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:23.163656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7a808561-aa76-4165-846b-295e38fc68bd None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:23.164841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7a808561-aa76-4165-846b-295e38fc68bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:23.234403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 499/996] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:23.257422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b400b-2e54-4fcb-bb7e-6712815ed70e None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:23.328195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:23.366733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b400b-2e54-4fcb-bb7e-6712815ed70e None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:23.405520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0876b13-e4f2-43cf-82fe-a78139bd6a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:23.406448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0876b13-e4f2-43cf-82fe-a78139bd6a82 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:23.406739 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0876b13-e4f2-43cf-82fe-a78139bd6a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:23.407009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0876b13-e4f2-43cf-82fe-a78139bd6a82 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:23.407673 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0876b13-e4f2-43cf-82fe-a78139bd6a82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:23.409048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0876b13-e4f2-43cf-82fe-a78139bd6a82 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-c0876b13-e4f2-43cf-82fe-a78139bd6a82 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:23.421231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:23.422606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 03:05:23.423489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:23.426675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 498/997] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:23.428773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213d0d0-2a75-43bd-a91e-4a5415750d73 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:23.429062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213d0d0-2a75-43bd-a91e-4a5415750d73 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:23.429339 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213d0d0-2a75-43bd-a91e-4a5415750d73 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:23.431841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 500/998] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:23.431969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0876b13-e4f2-43cf-82fe-a78139bd6a82 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:23.435698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a01a-4eb4-4831-84e4-a8b9f8f2dccc None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:23.435980 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a01a-4eb4-4831-84e4-a8b9f8f2dccc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:23.436250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a01a-4eb4-4831-84e4-a8b9f8f2dccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:23.453118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d7d5a01a-4eb4-4831-84e4-a8b9f8f2dccc None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:23.454317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d7d5a01a-4eb4-4831-84e4-a8b9f8f2dccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:23.486032 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:23.525550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 501/999] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:23.538232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0876b13-e4f2-43cf-82fe-a78139bd6a82 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:23.548546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5a01a-4eb4-4831-84e4-a8b9f8f2dccc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:23.567275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:23.573929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3977-7a11-4537-b3ac-4cf73be1c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:23.574630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3977-7a11-4537-b3ac-4cf73be1c07f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:23.574908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3977-7a11-4537-b3ac-4cf73be1c07f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:23.575180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3977-7a11-4537-b3ac-4cf73be1c07f None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:23.575890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e3977-7a11-4537-b3ac-4cf73be1c07f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:23.576211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e3977-7a11-4537-b3ac-4cf73be1c07f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:23.577551 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e3977-7a11-4537-b3ac-4cf73be1c07f None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:23.583077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 499/1000] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:05:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:23.588635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3977-7a11-4537-b3ac-4cf73be1c07f None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:23.662591 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5a01a-4eb4-4831-84e4-a8b9f8f2dccc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:23.701451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd791b6-c361-4aa2-bfd1-f7b6f6ee9342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:23.702581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd791b6-c361-4aa2-bfd1-f7b6f6ee9342 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:23.702859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd791b6-c361-4aa2-bfd1-f7b6f6ee9342 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:23.703274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd791b6-c361-4aa2-bfd1-f7b6f6ee9342 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:23.703898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd791b6-c361-4aa2-bfd1-f7b6f6ee9342 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:23.705275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd791b6-c361-4aa2-bfd1-f7b6f6ee9342 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:23.708518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3977-7a11-4537-b3ac-4cf73be1c07f None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-3cd791b6-c361-4aa2-bfd1-f7b6f6ee9342 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:23.717704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:23.719096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:23.720288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 502/1001] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Jun 28 03:05:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:23.725259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd791b6-c361-4aa2-bfd1-f7b6f6ee9342 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:23.748371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc23c4-1157-4661-8e0c-177bf07c7567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:23.749048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc23c4-1157-4661-8e0c-177bf07c7567 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:23.749326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc23c4-1157-4661-8e0c-177bf07c7567 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:23.749594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc23c4-1157-4661-8e0c-177bf07c7567 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:23.750654 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc23c4-1157-4661-8e0c-177bf07c7567 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:23.750968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc23c4-1157-4661-8e0c-177bf07c7567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:23.752604 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc23c4-1157-4661-8e0c-177bf07c7567 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:23.762121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 500/1002] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:05:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:23.763103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:23.763650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc23c4-1157-4661-8e0c-177bf07c7567 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:23.827513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:23.838601 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd791b6-c361-4aa2-bfd1-f7b6f6ee9342 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:23.875959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc23c4-1157-4661-8e0c-177bf07c7567 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:23.876976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac19f3-52af-4a06-8636-24677855e0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:23.877668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac19f3-52af-4a06-8636-24677855e0fc None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:23.877952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac19f3-52af-4a06-8636-24677855e0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:23.878958 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac19f3-52af-4a06-8636-24677855e0fc None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:23.878958 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac19f3-52af-4a06-8636-24677855e0fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:23.879333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac19f3-52af-4a06-8636-24677855e0fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:23.880744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac19f3-52af-4a06-8636-24677855e0fc None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:23.885931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 503/1003] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Jun 28 03:05:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:23.891608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac19f3-52af-4a06-8636-24677855e0fc None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:23.910154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b948e-2c8f-45b3-9dad-219b22b35321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:23.910865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b948e-2c8f-45b3-9dad-219b22b35321 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:23.911140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b948e-2c8f-45b3-9dad-219b22b35321 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:23.911406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b948e-2c8f-45b3-9dad-219b22b35321 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:23.912194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b948e-2c8f-45b3-9dad-219b22b35321 None admin] RBAC: Adding query filter params (interface=public, service_id=eec0e949dce84a55bfd01adb2e099bf2, region_id=RegionOne) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:23.912510 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b948e-2c8f-45b3-9dad-219b22b35321 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:23.913860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b948e-2c8f-45b3-9dad-219b22b35321 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:23.919139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 501/1004] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Jun 28 03:05:23 2022] GET /identity/v3/endpoints?service_id=eec0e949dce84a55bfd01adb2e099bf2&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:23.926108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b948e-2c8f-45b3-9dad-219b22b35321 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:24.009534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:24.018074 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac19f3-52af-4a06-8636-24677855e0fc None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:24.031666 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b948e-2c8f-45b3-9dad-219b22b35321 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:24.055594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:24.059502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c1f59-dd72-4f55-83cc-0caef29a9d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:24.060187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1f59-dd72-4f55-83cc-0caef29a9d78 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:24.060187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1f59-dd72-4f55-83cc-0caef29a9d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:24.060476 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1f59-dd72-4f55-83cc-0caef29a9d78 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:24.061178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c1f59-dd72-4f55-83cc-0caef29a9d78 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:24.061479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c1f59-dd72-4f55-83cc-0caef29a9d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:24.063118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c1f59-dd72-4f55-83cc-0caef29a9d78 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:24.068962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 504/1005] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Jun 28 03:05:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:24.074625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c1f59-dd72-4f55-83cc-0caef29a9d78 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:24.077748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27614d-7fff-4dde-8d2a-98eabf02610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:24.079095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27614d-7fff-4dde-8d2a-98eabf02610d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:24.079095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27614d-7fff-4dde-8d2a-98eabf02610d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:24.079095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27614d-7fff-4dde-8d2a-98eabf02610d None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:24.079825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27614d-7fff-4dde-8d2a-98eabf02610d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:24.081205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27614d-7fff-4dde-8d2a-98eabf02610d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:24.088304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 502/1006] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Jun 28 03:05:23 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:05:24.190757 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c1f59-dd72-4f55-83cc-0caef29a9d78 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:24.228840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ca8d8-fe19-4661-ab56-8494d1f5b358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:24.229525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ca8d8-fe19-4661-ab56-8494d1f5b358 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:24.229803 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ca8d8-fe19-4661-ab56-8494d1f5b358 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:24.230078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ca8d8-fe19-4661-ab56-8494d1f5b358 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:24.230859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ca8d8-fe19-4661-ab56-8494d1f5b358 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:24.232272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ca8d8-fe19-4661-ab56-8494d1f5b358 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:24.250833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 505/1007] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Jun 28 03:05:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:24.307154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade582-87f0-434e-ae8d-ec4e66dc863a None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:24.307689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade582-87f0-434e-ae8d-ec4e66dc863a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:24.307689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade582-87f0-434e-ae8d-ec4e66dc863a None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:24.309156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 503/1008] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:24.315304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c5d5-d874-4fe2-b72e-7dc42c1f1899 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:24.315644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c5d5-d874-4fe2-b72e-7dc42c1f1899 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:24.315875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c5d5-d874-4fe2-b72e-7dc42c1f1899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:24.334996 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9eb5c5d5-d874-4fe2-b72e-7dc42c1f1899 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:24.336222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9eb5c5d5-d874-4fe2-b72e-7dc42c1f1899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:24.351998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:24.417388 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 506/1009] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:24.440842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ade582-87f0-434e-ae8d-ec4e66dc863a None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:24.550384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ade582-87f0-434e-ae8d-ec4e66dc863a None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:24.589198 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1c8eb-e7be-4435-b2c3-e3089b436f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:24.590135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c8eb-e7be-4435-b2c3-e3089b436f67 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:24.590608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c8eb-e7be-4435-b2c3-e3089b436f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:24.591018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c8eb-e7be-4435-b2c3-e3089b436f67 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:24.591881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1c8eb-e7be-4435-b2c3-e3089b436f67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:24.593379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1c8eb-e7be-4435-b2c3-e3089b436f67 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:24.610523 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 504/1010] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:05:24 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:26.135345 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224010b-363c-459a-bf9b-f5d7edb2b81c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.135921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224010b-363c-459a-bf9b-f5d7edb2b81c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.135921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224010b-363c-459a-bf9b-f5d7edb2b81c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.140865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 507/1011] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:26.142829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb9a2-f8f5-4c54-9516-6dba3c0bae43 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.143239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb9a2-f8f5-4c54-9516-6dba3c0bae43 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.143331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb9a2-f8f5-4c54-9516-6dba3c0bae43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.161151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e65eb9a2-f8f5-4c54-9516-6dba3c0bae43 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:26.162399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e65eb9a2-f8f5-4c54-9516-6dba3c0bae43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:26.207990 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:26.241198 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 505/1012] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:26 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:26.265445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224010b-363c-459a-bf9b-f5d7edb2b81c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:26.305766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb40b47-8d9e-4542-9017-1646f18f214c None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.305953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb40b47-8d9e-4542-9017-1646f18f214c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.306227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb40b47-8d9e-4542-9017-1646f18f214c None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.307611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 506/1013] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:05:26.312917 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52df1b-9ac3-46d1-af4c-606403e80c76 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.313253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52df1b-9ac3-46d1-af4c-606403e80c76 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.313529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52df1b-9ac3-46d1-af4c-606403e80c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.331265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-1e52df1b-9ac3-46d1-af4c-606403e80c76 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:26.332507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1e52df1b-9ac3-46d1-af4c-606403e80c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:26.372328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224010b-363c-459a-bf9b-f5d7edb2b81c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:26.406730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 507/1014] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:26 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:26.408789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64045e20-a889-41c6-88a9-9277c3addb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:26.409885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64045e20-a889-41c6-88a9-9277c3addb80 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.410409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64045e20-a889-41c6-88a9-9277c3addb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.410886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64045e20-a889-41c6-88a9-9277c3addb80 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.411762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64045e20-a889-41c6-88a9-9277c3addb80 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:26.413340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64045e20-a889-41c6-88a9-9277c3addb80 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-64045e20-a889-41c6-88a9-9277c3addb80 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:26.425914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:26.426975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 03:05:26.427839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:26.429829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52df1b-9ac3-46d1-af4c-606403e80c76 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:26.434523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 508/1015] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:26.436334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64045e20-a889-41c6-88a9-9277c3addb80 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:26.449152 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:26.534792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52df1b-9ac3-46d1-af4c-606403e80c76 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:26.536449 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:26.544824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64045e20-a889-41c6-88a9-9277c3addb80 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:26.573553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a937b08-e827-4b71-9dcf-aa3d35f4fc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:26.574747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a937b08-e827-4b71-9dcf-aa3d35f4fc76 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.575144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a937b08-e827-4b71-9dcf-aa3d35f4fc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.575431 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a937b08-e827-4b71-9dcf-aa3d35f4fc76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.576620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a937b08-e827-4b71-9dcf-aa3d35f4fc76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:26.578121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a937b08-e827-4b71-9dcf-aa3d35f4fc76 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:26.578693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4eddd-269d-4af4-9739-09a0f104bdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:26.579363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4eddd-269d-4af4-9739-09a0f104bdaf None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.579640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4eddd-269d-4af4-9739-09a0f104bdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.579915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4eddd-269d-4af4-9739-09a0f104bdaf None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.580907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4eddd-269d-4af4-9739-09a0f104bdaf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:26.581213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4eddd-269d-4af4-9739-09a0f104bdaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:26.582619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4eddd-269d-4af4-9739-09a0f104bdaf None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:26.584855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 508/1016] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:26.585999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a937b08-e827-4b71-9dcf-aa3d35f4fc76 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:26.593148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 509/1017] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:05:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:26.594763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4eddd-269d-4af4-9739-09a0f104bdaf None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:26.666687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:26.698117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4eddd-269d-4af4-9739-09a0f104bdaf None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:26.699095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a937b08-e827-4b71-9dcf-aa3d35f4fc76 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:26.733039 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae61c4-e838-4d3e-89f3-cf4abbf30d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:26.733710 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae61c4-e838-4d3e-89f3-cf4abbf30d82 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.733989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae61c4-e838-4d3e-89f3-cf4abbf30d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.734732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae61c4-e838-4d3e-89f3-cf4abbf30d82 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.734853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0dec-67a9-4b35-922f-0a3e2c0c5e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:26.735228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae61c4-e838-4d3e-89f3-cf4abbf30d82 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:26.735400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0dec-67a9-4b35-922f-0a3e2c0c5e28 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.735498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0dec-67a9-4b35-922f-0a3e2c0c5e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.735583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae61c4-e838-4d3e-89f3-cf4abbf30d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:26.735775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0dec-67a9-4b35-922f-0a3e2c0c5e28 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.736476 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b0dec-67a9-4b35-922f-0a3e2c0c5e28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:26.736899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae61c4-e838-4d3e-89f3-cf4abbf30d82 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:26.738023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b0dec-67a9-4b35-922f-0a3e2c0c5e28 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:26.742322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 510/1018] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Jun 28 03:05:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:26.747413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9e58-994d-4f13-b67a-31e4500422b1 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.747413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9e58-994d-4f13-b67a-31e4500422b1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.747413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9e58-994d-4f13-b67a-31e4500422b1 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.747413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 511/1019] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:26.748215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d9e58-994d-4f13-b67a-31e4500422b1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:26.768733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 509/1020] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:05:26 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:26.770021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd89a-b0a3-41d7-9bda-dd2520d58e77 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.770315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd89a-b0a3-41d7-9bda-dd2520d58e77 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.770605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd89a-b0a3-41d7-9bda-dd2520d58e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.788900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-9bcdd89a-b0a3-41d7-9bda-dd2520d58e77 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:26.790105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9bcdd89a-b0a3-41d7-9bda-dd2520d58e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:26.809540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:26.868016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 510/1021] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:26 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:26.873553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d9e58-994d-4f13-b67a-31e4500422b1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:26.891023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdd89a-b0a3-41d7-9bda-dd2520d58e77 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:26.915135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbfd5b-28c5-4b52-94a2-e17a5487011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:26.915823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbfd5b-28c5-4b52-94a2-e17a5487011b None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:26.916106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbfd5b-28c5-4b52-94a2-e17a5487011b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:26.916381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbfd5b-28c5-4b52-94a2-e17a5487011b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:26.917138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbfd5b-28c5-4b52-94a2-e17a5487011b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:26.918624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbfd5b-28c5-4b52-94a2-e17a5487011b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:26.923623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:26.946197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 512/1022] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Jun 28 03:05:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:05:27.006781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdd89a-b0a3-41d7-9bda-dd2520d58e77 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:27.052279 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a21566-ac74-42dc-b7da-370d8e8e7cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:27.053101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a21566-ac74-42dc-b7da-370d8e8e7cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:27.053379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a21566-ac74-42dc-b7da-370d8e8e7cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:27.053647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a21566-ac74-42dc-b7da-370d8e8e7cd9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:27.054318 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a21566-ac74-42dc-b7da-370d8e8e7cd9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:27.055691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a21566-ac74-42dc-b7da-370d8e8e7cd9 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-b3a21566-ac74-42dc-b7da-370d8e8e7cd9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:27.070141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:27.071294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:27.072743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 511/1023] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Jun 28 03:05:26 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:27.077634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbfd5b-28c5-4b52-94a2-e17a5487011b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:27.187806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbfd5b-28c5-4b52-94a2-e17a5487011b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:27.222881 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3ff0-a3a4-4322-bed2-1fb3da73d051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:27.223563 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3ff0-a3a4-4322-bed2-1fb3da73d051 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:27.223848 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3ff0-a3a4-4322-bed2-1fb3da73d051 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:27.224121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3ff0-a3a4-4322-bed2-1fb3da73d051 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:27.224839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d3ff0-a3a4-4322-bed2-1fb3da73d051 None admin] RBAC: Adding query filter params (name=image) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:27.225144 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d3ff0-a3a4-4322-bed2-1fb3da73d051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:27.226571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d3ff0-a3a4-4322-bed2-1fb3da73d051 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:27.232063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 513/1024] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:27.237718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a21566-ac74-42dc-b7da-370d8e8e7cd9 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:27.255451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:27.340713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a21566-ac74-42dc-b7da-370d8e8e7cd9 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:27.376522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59356205-5774-4d43-9a97-41f81defcd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:27.377209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59356205-5774-4d43-9a97-41f81defcd09 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:27.377485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59356205-5774-4d43-9a97-41f81defcd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:27.377748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59356205-5774-4d43-9a97-41f81defcd09 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:27.378491 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59356205-5774-4d43-9a97-41f81defcd09 None admin] RBAC: Adding query filter params (type=image) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:27.378794 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59356205-5774-4d43-9a97-41f81defcd09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:27.380163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59356205-5774-4d43-9a97-41f81defcd09 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:27.386687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 512/1025] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:27.392141 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3ff0-a3a4-4322-bed2-1fb3da73d051 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:27.453586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:27.501853 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3ff0-a3a4-4322-bed2-1fb3da73d051 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:27.537708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b874a26-d318-46dd-b160-0d88243697ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:27.538773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874a26-d318-46dd-b160-0d88243697ef None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:27.539254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874a26-d318-46dd-b160-0d88243697ef None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:27.539720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874a26-d318-46dd-b160-0d88243697ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:27.540709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b874a26-d318-46dd-b160-0d88243697ef None admin] RBAC: Adding query filter params (interface=public, service_id=f71d6a02e9c042b3ad40ca057d3c554d, region_id=RegionOne) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:27.541264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b874a26-d318-46dd-b160-0d88243697ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:27.542854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b874a26-d318-46dd-b160-0d88243697ef None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:27.553014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 514/1026] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Jun 28 03:05:27 2022] GET /identity/v3/endpoints?service_id=f71d6a02e9c042b3ad40ca057d3c554d&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:27.554765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59356205-5774-4d43-9a97-41f81defcd09 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:27.634547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:27.658278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59356205-5774-4d43-9a97-41f81defcd09 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:27.692575 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81433c7f-8830-46a9-9881-cd6ced5d5512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:27.693487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433c7f-8830-46a9-9881-cd6ced5d5512 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:27.693912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433c7f-8830-46a9-9881-cd6ced5d5512 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:27.694351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433c7f-8830-46a9-9881-cd6ced5d5512 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:27.695199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81433c7f-8830-46a9-9881-cd6ced5d5512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:27.696721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81433c7f-8830-46a9-9881-cd6ced5d5512 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:27.704918 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 513/1027] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Jun 28 03:05:27 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:05:28.886796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5101a3e-5c8e-4176-8ff9-be730744d919 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:28.887347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5101a3e-5c8e-4176-8ff9-be730744d919 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:28.887347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5101a3e-5c8e-4176-8ff9-be730744d919 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:28.888672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 515/1028] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:28.894166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b69168-37af-4181-98fe-569858343cab None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:28.894603 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b69168-37af-4181-98fe-569858343cab None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:28.894792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b69168-37af-4181-98fe-569858343cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:28.912245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-06b69168-37af-4181-98fe-569858343cab None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:28.913424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-06b69168-37af-4181-98fe-569858343cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:28.984953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 514/1029] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:29.009792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5101a3e-5c8e-4176-8ff9-be730744d919 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:29.081834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f4c0-8102-47e5-b208-42a576711951 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:29.082150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f4c0-8102-47e5-b208-42a576711951 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:29.082440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f4c0-8102-47e5-b208-42a576711951 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:29.083844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 515/1030] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:05:29.088682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f008-f279-4737-83aa-3d909ee18ed9 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:29.088970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f008-f279-4737-83aa-3d909ee18ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:29.089246 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f008-f279-4737-83aa-3d909ee18ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:29.105795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8146f008-f279-4737-83aa-3d909ee18ed9 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:29.107009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8146f008-f279-4737-83aa-3d909ee18ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:29.141293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5101a3e-5c8e-4176-8ff9-be730744d919 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:29.164022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:29.173385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:29.178809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 516/1031] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:29.186014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ead0d-0208-4a98-9ede-b867140017eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:29.186857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ead0d-0208-4a98-9ede-b867140017eb None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:29.187155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ead0d-0208-4a98-9ede-b867140017eb None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:29.187590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ead0d-0208-4a98-9ede-b867140017eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:29.189166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ead0d-0208-4a98-9ede-b867140017eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:29.190706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ead0d-0208-4a98-9ede-b867140017eb None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:29.192437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 516/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:29.197901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146f008-f279-4737-83aa-3d909ee18ed9 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:29.201440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ead0d-0208-4a98-9ede-b867140017eb None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:29.301500 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146f008-f279-4737-83aa-3d909ee18ed9 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:29.304908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ead0d-0208-4a98-9ede-b867140017eb None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:29.335999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28905-7ac3-42c9-8af2-8c74b221ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:29.336686 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28905-7ac3-42c9-8af2-8c74b221ce1c None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:29.336971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28905-7ac3-42c9-8af2-8c74b221ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:29.337249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28905-7ac3-42c9-8af2-8c74b221ce1c None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:29.338027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b28905-7ac3-42c9-8af2-8c74b221ce1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:29.339437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b28905-7ac3-42c9-8af2-8c74b221ce1c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:29.340473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2f950-0f6f-4adf-89a0-d2219230b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:29.341302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f950-0f6f-4adf-89a0-d2219230b76c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:29.341582 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f950-0f6f-4adf-89a0-d2219230b76c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:29.341851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f950-0f6f-4adf-89a0-d2219230b76c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:29.353090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2f950-0f6f-4adf-89a0-d2219230b76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:29.366326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 517/1033] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:05:29 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-54b2f950-0f6f-4adf-89a0-d2219230b76c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:29.366550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:29.367427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:29.368281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 517/1034] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Jun 28 03:05:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:29.373325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28905-7ac3-42c9-8af2-8c74b221ce1c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:29.433113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:29.483197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28905-7ac3-42c9-8af2-8c74b221ce1c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:29.522328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209380-d990-4937-af79-5d136168edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:29.523065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209380-d990-4937-af79-5d136168edb9 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:29.523347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209380-d990-4937-af79-5d136168edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:29.523620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209380-d990-4937-af79-5d136168edb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:29.524393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df209380-d990-4937-af79-5d136168edb9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:29.524699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df209380-d990-4937-af79-5d136168edb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:29.526108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df209380-d990-4937-af79-5d136168edb9 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:29.536569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 518/1035] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Jun 28 03:05:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:29.541380 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2f950-0f6f-4adf-89a0-d2219230b76c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:29.599113 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:29.653788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2f950-0f6f-4adf-89a0-d2219230b76c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:29.688598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93d907-0970-47f8-b038-8069735ba8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:29.689364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d907-0970-47f8-b038-8069735ba8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:29.689728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d907-0970-47f8-b038-8069735ba8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:29.690015 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d907-0970-47f8-b038-8069735ba8e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:29.701886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93d907-0970-47f8-b038-8069735ba8e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:29.703455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93d907-0970-47f8-b038-8069735ba8e4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-2c93d907-0970-47f8-b038-8069735ba8e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:29.721939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:29.722917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:29.723828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:29.723828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:29.723828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:29.723828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:29.723828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 518/1036] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:29.729889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209380-d990-4937-af79-5d136168edb9 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:29.748552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a1a18-b775-4c05-ad7c-460f74f8d3b2 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:29.748837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a1a18-b775-4c05-ad7c-460f74f8d3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:29.749112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a1a18-b775-4c05-ad7c-460f74f8d3b2 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:29.750608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 519/1037] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:29.755914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca94f-d9bd-4872-bb6b-28f1ed466621 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:29.756202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca94f-d9bd-4872-bb6b-28f1ed466621 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:29.756481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca94f-d9bd-4872-bb6b-28f1ed466621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:29.775228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-84dca94f-d9bd-4872-bb6b-28f1ed466621 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:29.776430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-84dca94f-d9bd-4872-bb6b-28f1ed466621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:29.837453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209380-d990-4937-af79-5d136168edb9 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:29.849308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 520/1038] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:29.859109 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:29.873814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dca94f-d9bd-4872-bb6b-28f1ed466621 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:29.883317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce22bab-46b6-439d-aa14-d954b6ad07a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:29.884241 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22bab-46b6-439d-aa14-d954b6ad07a6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:29.884671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22bab-46b6-439d-aa14-d954b6ad07a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:29.885079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22bab-46b6-439d-aa14-d954b6ad07a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:29.885958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce22bab-46b6-439d-aa14-d954b6ad07a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:29.886259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce22bab-46b6-439d-aa14-d954b6ad07a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:29.887675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce22bab-46b6-439d-aa14-d954b6ad07a6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:29.900542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 519/1039] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:29.905962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce22bab-46b6-439d-aa14-d954b6ad07a6 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:29.907062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:29.985914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dca94f-d9bd-4872-bb6b-28f1ed466621 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:30.027883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6647e04-01d9-453e-9f3e-4a8b3e19ab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:30.027883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6647e04-01d9-453e-9f3e-4a8b3e19ab18 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:30.027883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6647e04-01d9-453e-9f3e-4a8b3e19ab18 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:30.027883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6647e04-01d9-453e-9f3e-4a8b3e19ab18 None admin] PATH_INFO: `/v3/services/image` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:30.028343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6647e04-01d9-453e-9f3e-4a8b3e19ab18 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:30.029493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6647e04-01d9-453e-9f3e-4a8b3e19ab18 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:30.041376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce22bab-46b6-439d-aa14-d954b6ad07a6 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b6647e04-01d9-453e-9f3e-4a8b3e19ab18 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:30.042200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:30.043298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 03:05:30.044155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:30.050101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 521/1040] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Jun 28 03:05:29 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:30.050101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6647e04-01d9-453e-9f3e-4a8b3e19ab18 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:30.087288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839840d4-47a1-4a0f-b2db-56769adf4a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:30.088094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839840d4-47a1-4a0f-b2db-56769adf4a6e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:30.088373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839840d4-47a1-4a0f-b2db-56769adf4a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:30.088640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839840d4-47a1-4a0f-b2db-56769adf4a6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:30.096560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839840d4-47a1-4a0f-b2db-56769adf4a6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:30.098106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839840d4-47a1-4a0f-b2db-56769adf4a6e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-839840d4-47a1-4a0f-b2db-56769adf4a6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:05:30.113661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:30.115272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:30.116285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:30.116285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:30.116285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:05:30.116285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:05:30.116285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:05:30.116285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:05:30.116285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:05:30.116285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:05:30.116285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:05:30.116285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:30.116285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 520/1041] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Jun 28 03:05:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:30.121213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839840d4-47a1-4a0f-b2db-56769adf4a6e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:30.149097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:30.157108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6647e04-01d9-453e-9f3e-4a8b3e19ab18 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:30.164057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:30.191974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb03c1-f215-4db5-87b7-7338c1208778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:30.192656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb03c1-f215-4db5-87b7-7338c1208778 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:30.192936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb03c1-f215-4db5-87b7-7338c1208778 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:30.193208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb03c1-f215-4db5-87b7-7338c1208778 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:30.193944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb03c1-f215-4db5-87b7-7338c1208778 None admin] RBAC: Adding query filter params (name=image) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:30.194250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb03c1-f215-4db5-87b7-7338c1208778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:30.195651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb03c1-f215-4db5-87b7-7338c1208778 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:30.201276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 522/1042] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:30.206558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb03c1-f215-4db5-87b7-7338c1208778 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:30.234798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839840d4-47a1-4a0f-b2db-56769adf4a6e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:30.276921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248f54c-9762-4b99-831c-ba9d7e8f02fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:30.277561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248f54c-9762-4b99-831c-ba9d7e8f02fe None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:30.277799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248f54c-9762-4b99-831c-ba9d7e8f02fe None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:30.278071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248f54c-9762-4b99-831c-ba9d7e8f02fe None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:30.279201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248f54c-9762-4b99-831c-ba9d7e8f02fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:30.279327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248f54c-9762-4b99-831c-ba9d7e8f02fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:30.280659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248f54c-9762-4b99-831c-ba9d7e8f02fe None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:30.303034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 521/1043] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Jun 28 03:05:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:30.304182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248f54c-9762-4b99-831c-ba9d7e8f02fe None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:30.322695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb03c1-f215-4db5-87b7-7338c1208778 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:30.357277 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc3708-9aab-4cc2-a664-71793efd9e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:30.358297 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc3708-9aab-4cc2-a664-71793efd9e03 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:30.358607 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc3708-9aab-4cc2-a664-71793efd9e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:30.358884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc3708-9aab-4cc2-a664-71793efd9e03 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:30.359594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc3708-9aab-4cc2-a664-71793efd9e03 None admin] RBAC: Adding query filter params (type=image) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:30.360051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc3708-9aab-4cc2-a664-71793efd9e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:30.361439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc3708-9aab-4cc2-a664-71793efd9e03 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:30.367048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 523/1044] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:30.373022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc3708-9aab-4cc2-a664-71793efd9e03 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:30.402130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:30.416562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:30.425359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248f54c-9762-4b99-831c-ba9d7e8f02fe None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:30.462990 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3b112-9341-4ae3-9b34-c6b1ac780001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:30.463963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3b112-9341-4ae3-9b34-c6b1ac780001 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:30.464248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3b112-9341-4ae3-9b34-c6b1ac780001 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:30.464526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3b112-9341-4ae3-9b34-c6b1ac780001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:30.486581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc3708-9aab-4cc2-a664-71793efd9e03 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:30.525087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f600b-95f9-40ab-a8b8-ea4a3841b489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:30.525892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f600b-95f9-40ab-a8b8-ea4a3841b489 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:30.526233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f600b-95f9-40ab-a8b8-ea4a3841b489 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:30.526622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f600b-95f9-40ab-a8b8-ea4a3841b489 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:30.527423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f600b-95f9-40ab-a8b8-ea4a3841b489 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:30.528754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f600b-95f9-40ab-a8b8-ea4a3841b489 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:30.535270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3b112-9341-4ae3-9b34-c6b1ac780001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:30.536959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3b112-9341-4ae3-9b34-c6b1ac780001 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:30.549969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 524/1045] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Jun 28 03:05:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:30.649253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:30.663142 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 522/1046] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:05:30.664461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f600b-95f9-40ab-a8b8-ea4a3841b489 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:30.758376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:30.789761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f600b-95f9-40ab-a8b8-ea4a3841b489 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:30.825359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d373e55-c2b1-4e67-aefe-90a211c3f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:30.826183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373e55-c2b1-4e67-aefe-90a211c3f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:30.826494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373e55-c2b1-4e67-aefe-90a211c3f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:30.826739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373e55-c2b1-4e67-aefe-90a211c3f3f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:30.837689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d373e55-c2b1-4e67-aefe-90a211c3f3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:30.839183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d373e55-c2b1-4e67-aefe-90a211c3f3f6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-4d373e55-c2b1-4e67-aefe-90a211c3f3f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:30.856371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:30.857301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:30.858209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:30.858209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:30.858209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:30.858209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:30.858209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 525/1047] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:30.863576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3b112-9341-4ae3-9b34-c6b1ac780001 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:30.965187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3b112-9341-4ae3-9b34-c6b1ac780001 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:31.000140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92d5c-41b5-4ebb-9798-106310976028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:31.000819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92d5c-41b5-4ebb-9798-106310976028 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:31.001096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92d5c-41b5-4ebb-9798-106310976028 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:31.001361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92d5c-41b5-4ebb-9798-106310976028 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:31.002078 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c92d5c-41b5-4ebb-9798-106310976028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:31.002406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c92d5c-41b5-4ebb-9798-106310976028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:31.003767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c92d5c-41b5-4ebb-9798-106310976028 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:31.015325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 523/1048] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:31.020841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d373e55-c2b1-4e67-aefe-90a211c3f3f6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:31.139804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d373e55-c2b1-4e67-aefe-90a211c3f3f6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:31.167275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:31.177165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe8458-a2e4-49fc-9458-05dea30a7592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:31.177980 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8458-a2e4-49fc-9458-05dea30a7592 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:31.178267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8458-a2e4-49fc-9458-05dea30a7592 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:31.178633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8458-a2e4-49fc-9458-05dea30a7592 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:31.185604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe8458-a2e4-49fc-9458-05dea30a7592 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:31.187084 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe8458-a2e4-49fc-9458-05dea30a7592 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-f4fe8458-a2e4-49fc-9458-05dea30a7592 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:05:31.201743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:31.203098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:31.204024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:05:31.204024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:05:31.204024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:05:31.204024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:05:31.204024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:05:31.204024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:05:31.204024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:31.204024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:31.204024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 526/1049] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:31.208891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92d5c-41b5-4ebb-9798-106310976028 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:31.266670 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:31.312701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92d5c-41b5-4ebb-9798-106310976028 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:31.346225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e4c27-89c5-4d51-b38a-e53b7c7906f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:31.346960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4c27-89c5-4d51-b38a-e53b7c7906f6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:31.347244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4c27-89c5-4d51-b38a-e53b7c7906f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:31.347515 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4c27-89c5-4d51-b38a-e53b7c7906f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:31.348303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e4c27-89c5-4d51-b38a-e53b7c7906f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:31.348610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e4c27-89c5-4d51-b38a-e53b7c7906f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:31.350041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e4c27-89c5-4d51-b38a-e53b7c7906f6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:31.367697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 524/1050] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:05:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:31.369188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe8458-a2e4-49fc-9458-05dea30a7592 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:31.468116 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe8458-a2e4-49fc-9458-05dea30a7592 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:31.502866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ed7eb-a8f8-44ea-9817-482a1b42667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:31.503533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ed7eb-a8f8-44ea-9817-482a1b42667f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:31.503810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ed7eb-a8f8-44ea-9817-482a1b42667f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:31.504090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ed7eb-a8f8-44ea-9817-482a1b42667f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:31.504925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ed7eb-a8f8-44ea-9817-482a1b42667f None admin] RBAC: Adding query filter params (role.id=421505fc5382430bb34c838f9ac50c45, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=b1868e9d8b004c4fb781e532c775428e) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:31.505232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ed7eb-a8f8-44ea-9817-482a1b42667f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:31.506697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ed7eb-a8f8-44ea-9817-482a1b42667f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:31.512434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 527/1051] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:31 2022] GET /identity/v3/role_assignments?user.id=b1868e9d8b004c4fb781e532c775428e&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=421505fc5382430bb34c838f9ac50c45 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:31.525604 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d993085-7f0e-4389-8325-f8e049cbb248 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:31.525928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d993085-7f0e-4389-8325-f8e049cbb248 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:31.526164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d993085-7f0e-4389-8325-f8e049cbb248 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:31.527842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 525/1052] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:31.534011 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950e29-7a94-4932-8cac-f5b415aaa9a2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:31.534283 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950e29-7a94-4932-8cac-f5b415aaa9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:31.534598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950e29-7a94-4932-8cac-f5b415aaa9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:31.552702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-07950e29-7a94-4932-8cac-f5b415aaa9a2 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:31.553922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-07950e29-7a94-4932-8cac-f5b415aaa9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:31.607511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:31.633056 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 528/1053] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:31.657232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d993085-7f0e-4389-8325-f8e049cbb248 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:31.773145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d993085-7f0e-4389-8325-f8e049cbb248 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:31.791108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:31.811250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f971b1-c312-4367-b315-c9aebe5d49a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:31.812406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f971b1-c312-4367-b315-c9aebe5d49a1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:31.812799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f971b1-c312-4367-b315-c9aebe5d49a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:31.813121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f971b1-c312-4367-b315-c9aebe5d49a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:31.823613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f971b1-c312-4367-b315-c9aebe5d49a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-54f971b1-c312-4367-b315-c9aebe5d49a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:31.831331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:31.832414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:31.833440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:31.835019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 526/1054] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:05:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:31.840882 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950e29-7a94-4932-8cac-f5b415aaa9a2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:31.942153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950e29-7a94-4932-8cac-f5b415aaa9a2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:31.979118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35814f52-b839-46f3-9f87-ef2e63eb394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:31.979800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35814f52-b839-46f3-9f87-ef2e63eb394f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:31.980080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35814f52-b839-46f3-9f87-ef2e63eb394f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:31.980352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35814f52-b839-46f3-9f87-ef2e63eb394f None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:31.981098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35814f52-b839-46f3-9f87-ef2e63eb394f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:31.981404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35814f52-b839-46f3-9f87-ef2e63eb394f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:31.982821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35814f52-b839-46f3-9f87-ef2e63eb394f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:31.991793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 529/1055] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:05:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:31.997417 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f971b1-c312-4367-b315-c9aebe5d49a1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:32.137997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f971b1-c312-4367-b315-c9aebe5d49a1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:32.176732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c2095-b432-478b-bd12-607c65bb0545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:32.177627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c2095-b432-478b-bd12-607c65bb0545 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:32.177905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c2095-b432-478b-bd12-607c65bb0545 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:32.178171 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c2095-b432-478b-bd12-607c65bb0545 None admin] PATH_INFO: `/v3/users/e3ed095db7b24bdc99e5fa6bde81edc9` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:32.192291 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c2095-b432-478b-bd12-607c65bb0545 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ed095db7b24bdc99e5fa6bde81edc9)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:32.193666 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c2095-b432-478b-bd12-607c65bb0545 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:32.195636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 527/1056] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:05:31 2022] GET /identity/v3/users/e3ed095db7b24bdc99e5fa6bde81edc9 => generated 285 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:32.201286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35814f52-b839-46f3-9f87-ef2e63eb394f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:32.246242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:32.305395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35814f52-b839-46f3-9f87-ef2e63eb394f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:32.341014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066fb8d-a4b5-475f-b4eb-fb071336c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:32.341804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066fb8d-a4b5-475f-b4eb-fb071336c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:32.342181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066fb8d-a4b5-475f-b4eb-fb071336c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:32.342585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066fb8d-a4b5-475f-b4eb-fb071336c0d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:32.411419 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066fb8d-a4b5-475f-b4eb-fb071336c0d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:32.413894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066fb8d-a4b5-475f-b4eb-fb071336c0d3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:32.468053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:32.529597 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 530/1057] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:05:32.535689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c2095-b432-478b-bd12-607c65bb0545 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:32.571448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:32.645076 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c2095-b432-478b-bd12-607c65bb0545 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:32.665909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928c82-2d40-45f9-9d16-005ddb6c4ef1 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:32.666283 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928c82-2d40-45f9-9d16-005ddb6c4ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:32.666586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928c82-2d40-45f9-9d16-005ddb6c4ef1 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:32.668114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 531/1058] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:32.674374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe74d6a-778e-4eed-8eb0-90fd512e7519 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:32.674662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe74d6a-778e-4eed-8eb0-90fd512e7519 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:32.674933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe74d6a-778e-4eed-8eb0-90fd512e7519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:32.685244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b740fd-c923-4aa7-861b-c6da90e468ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:32.686128 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b740fd-c923-4aa7-861b-c6da90e468ae None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:32.686416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b740fd-c923-4aa7-861b-c6da90e468ae None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:32.686697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b740fd-c923-4aa7-861b-c6da90e468ae None admin] PATH_INFO: `/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:32.688630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b740fd-c923-4aa7-861b-c6da90e468ae None admin] RBAC: Authorizing `identity:get_project(project_id=1ae0cf635ef54cbf9f377d6cb4599504)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:32.690113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b740fd-c923-4aa7-861b-c6da90e468ae None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:32.692125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 528/1059] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:05:32 2022] GET /identity/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:32.693404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-afe74d6a-778e-4eed-8eb0-90fd512e7519 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:32.694617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-afe74d6a-778e-4eed-8eb0-90fd512e7519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:32.698033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b740fd-c923-4aa7-861b-c6da90e468ae None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:32.769092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 532/1060] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:32.791065 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe74d6a-778e-4eed-8eb0-90fd512e7519 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:32.813956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b740fd-c923-4aa7-861b-c6da90e468ae None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:32.815819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:32.853215 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b2de0-fb62-44bb-a0cd-18b413a22401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:32.854018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b2de0-fb62-44bb-a0cd-18b413a22401 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:32.854441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b2de0-fb62-44bb-a0cd-18b413a22401 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:32.854818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b2de0-fb62-44bb-a0cd-18b413a22401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:32.855855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b2de0-fb62-44bb-a0cd-18b413a22401 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=1ae0cf635ef54cbf9f377d6cb4599504, user.id=e3ed095db7b24bdc99e5fa6bde81edc9) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:32.856284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b2de0-fb62-44bb-a0cd-18b413a22401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:32.857924 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b2de0-fb62-44bb-a0cd-18b413a22401 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:32.860718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:32.866140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 529/1061] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:32 2022] GET /identity/v3/role_assignments?user.id=e3ed095db7b24bdc99e5fa6bde81edc9&scope.project.id=1ae0cf635ef54cbf9f377d6cb4599504&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:32.903407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe74d6a-778e-4eed-8eb0-90fd512e7519 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:32.941462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af7abc-5afa-4a9e-9e87-26fb7e87723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:32.942141 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af7abc-5afa-4a9e-9e87-26fb7e87723d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:32.942464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af7abc-5afa-4a9e-9e87-26fb7e87723d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:32.942737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af7abc-5afa-4a9e-9e87-26fb7e87723d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:33.017120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af7abc-5afa-4a9e-9e87-26fb7e87723d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:33.018878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af7abc-5afa-4a9e-9e87-26fb7e87723d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:33.097593 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:33.130451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 533/1062] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 28 03:05:33.136250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b2de0-fb62-44bb-a0cd-18b413a22401 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:33.238083 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b2de0-fb62-44bb-a0cd-18b413a22401 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:33.273835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bead06-fdc4-4338-bef2-440fc20f7739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:33.274686 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bead06-fdc4-4338-bef2-440fc20f7739 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:33.274946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bead06-fdc4-4338-bef2-440fc20f7739 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:33.275242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bead06-fdc4-4338-bef2-440fc20f7739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:33.286331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bead06-fdc4-4338-bef2-440fc20f7739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:33.287796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bead06-fdc4-4338-bef2-440fc20f7739 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-60bead06-fdc4-4338-bef2-440fc20f7739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:33.305590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:33.306552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:33.307465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:33.307465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:33.307465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:33.307465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:33.308360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 530/1063] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:33.313081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af7abc-5afa-4a9e-9e87-26fb7e87723d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:33.416481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af7abc-5afa-4a9e-9e87-26fb7e87723d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:33.450745 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf54fbc-636e-47b9-9500-398ee8b03e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:33.451422 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf54fbc-636e-47b9-9500-398ee8b03e54 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:33.451705 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf54fbc-636e-47b9-9500-398ee8b03e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:33.451981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf54fbc-636e-47b9-9500-398ee8b03e54 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:33.452859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf54fbc-636e-47b9-9500-398ee8b03e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:33.453084 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf54fbc-636e-47b9-9500-398ee8b03e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:33.454485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf54fbc-636e-47b9-9500-398ee8b03e54 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:33.466023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 534/1064] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:33.553100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d307-e587-487b-aef9-a86ba9770547 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:33.553468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d307-e587-487b-aef9-a86ba9770547 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:33.553627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d307-e587-487b-aef9-a86ba9770547 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:33.555114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 531/1065] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:33.561192 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2daf86-2ff0-47aa-9a1d-1137af1ee9ca None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:33.561387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2daf86-2ff0-47aa-9a1d-1137af1ee9ca None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:33.561625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2daf86-2ff0-47aa-9a1d-1137af1ee9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:33.580051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-aa2daf86-2ff0-47aa-9a1d-1137af1ee9ca None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:33.581258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-aa2daf86-2ff0-47aa-9a1d-1137af1ee9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:33.611600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:33.658378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 535/1066] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:33.681117 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609d307-e587-487b-aef9-a86ba9770547 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:33.704850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:33.801745 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609d307-e587-487b-aef9-a86ba9770547 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:33.849600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876964ef-dc3c-4540-9d91-487475e287ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:33.850835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876964ef-dc3c-4540-9d91-487475e287ca None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:33.851263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876964ef-dc3c-4540-9d91-487475e287ca None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:33.851647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876964ef-dc3c-4540-9d91-487475e287ca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:33.863176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876964ef-dc3c-4540-9d91-487475e287ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-876964ef-dc3c-4540-9d91-487475e287ca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:33.871758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:33.872715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:33.873558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 532/1067] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Jun 28 03:05:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:33.879656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2daf86-2ff0-47aa-9a1d-1137af1ee9ca None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:33.982682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2daf86-2ff0-47aa-9a1d-1137af1ee9ca None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:34.018341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebb202-15d7-49f0-861d-727431f23040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:34.019036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebb202-15d7-49f0-861d-727431f23040 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:34.019313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebb202-15d7-49f0-861d-727431f23040 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:34.019584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebb202-15d7-49f0-861d-727431f23040 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:34.020331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebb202-15d7-49f0-861d-727431f23040 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:34.020635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebb202-15d7-49f0-861d-727431f23040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:34.022016 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebb202-15d7-49f0-861d-727431f23040 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:34.030208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 536/1068] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Jun 28 03:05:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:34.036154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876964ef-dc3c-4540-9d91-487475e287ca None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:34.118660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:34.145377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876964ef-dc3c-4540-9d91-487475e287ca None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:34.182221 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53937-3fa1-420f-bf8b-1da626e0954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:34.183056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53937-3fa1-420f-bf8b-1da626e0954c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:34.183339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53937-3fa1-420f-bf8b-1da626e0954c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:34.183613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53937-3fa1-420f-bf8b-1da626e0954c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:34.194924 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d53937-3fa1-420f-bf8b-1da626e0954c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:34.196377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d53937-3fa1-420f-bf8b-1da626e0954c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-38d53937-3fa1-420f-bf8b-1da626e0954c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:34.213496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:34.214421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:34.215405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:34.215405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:34.215405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:34.215405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:34.215405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 533/1069] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:34.220697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebb202-15d7-49f0-861d-727431f23040 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:34.247314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:34.325713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebb202-15d7-49f0-861d-727431f23040 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:34.361078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c14c-604e-4a45-931e-b28851d1c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:34.361739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c14c-604e-4a45-931e-b28851d1c54f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:34.362016 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c14c-604e-4a45-931e-b28851d1c54f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:34.362281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c14c-604e-4a45-931e-b28851d1c54f None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:34.363026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3c14c-604e-4a45-931e-b28851d1c54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:34.363322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3c14c-604e-4a45-931e-b28851d1c54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:34.365063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3c14c-604e-4a45-931e-b28851d1c54f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:34.377243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 537/1070] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:34.382955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53937-3fa1-420f-bf8b-1da626e0954c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:34.490697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53937-3fa1-420f-bf8b-1da626e0954c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:34.520695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:34.527381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df3ae2-b5c3-446c-918b-6ad7b0384c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:34.528190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3ae2-b5c3-446c-918b-6ad7b0384c8a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:34.528465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3ae2-b5c3-446c-918b-6ad7b0384c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:34.528736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3ae2-b5c3-446c-918b-6ad7b0384c8a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:34.537112 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df3ae2-b5c3-446c-918b-6ad7b0384c8a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:34.538581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df3ae2-b5c3-446c-918b-6ad7b0384c8a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-79df3ae2-b5c3-446c-918b-6ad7b0384c8a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:05:34.552914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:34.553915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:34.554911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:34.554911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:34.554911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:05:34.554911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:05:34.554911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:05:34.554911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:05:34.554911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:05:34.554911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:05:34.554911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:05:34.554911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:34.554911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 534/1071] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Jun 28 03:05:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:34.559970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c14c-604e-4a45-931e-b28851d1c54f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:34.648198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:34.666219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c14c-604e-4a45-931e-b28851d1c54f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:34.702207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6969a3-fc47-4507-8e7a-3a0d1e45466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:34.703114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6969a3-fc47-4507-8e7a-3a0d1e45466b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:34.703792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6969a3-fc47-4507-8e7a-3a0d1e45466b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:34.704065 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6969a3-fc47-4507-8e7a-3a0d1e45466b None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:34.704905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6969a3-fc47-4507-8e7a-3a0d1e45466b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:34.705210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6969a3-fc47-4507-8e7a-3a0d1e45466b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:34.706676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6969a3-fc47-4507-8e7a-3a0d1e45466b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:34.724140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 538/1072] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Jun 28 03:05:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:34.729824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df3ae2-b5c3-446c-918b-6ad7b0384c8a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:34.841920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df3ae2-b5c3-446c-918b-6ad7b0384c8a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:34.878890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2ce55-a993-42c5-8f64-9edc8d7d3954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:34.879692 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ce55-a993-42c5-8f64-9edc8d7d3954 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:34.879967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ce55-a993-42c5-8f64-9edc8d7d3954 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:34.880233 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ce55-a993-42c5-8f64-9edc8d7d3954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:34.890241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496f80-c5cf-4b47-ae8e-8d6ad88043ec None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:34.890556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496f80-c5cf-4b47-ae8e-8d6ad88043ec None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:34.890834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496f80-c5cf-4b47-ae8e-8d6ad88043ec None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:34.891451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2ce55-a993-42c5-8f64-9edc8d7d3954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:34.892237 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 539/1073] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:34.892903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2ce55-a993-42c5-8f64-9edc8d7d3954 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:34.898345 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c764f4d-05b6-43fd-b990-ae92125cd544 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:34.898620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c764f4d-05b6-43fd-b990-ae92125cd544 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:34.898840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c764f4d-05b6-43fd-b990-ae92125cd544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-20a2ce55-a993-42c5-8f64-9edc8d7d3954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:34.910155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:34.911077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:34.911971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:34.911971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:34.911971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:34.911971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:34.911971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 535/1074] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:34.917063 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2ce55-a993-42c5-8f64-9edc8d7d3954 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:34.918246 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2c764f4d-05b6-43fd-b990-ae92125cd544 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:34.919474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2c764f4d-05b6-43fd-b990-ae92125cd544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:34.962193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:34.989565 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 540/1075] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:35.011958 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c764f4d-05b6-43fd-b990-ae92125cd544 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:35.018955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2ce55-a993-42c5-8f64-9edc8d7d3954 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:35.054563 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1487f31-11f3-42c4-af0e-642858ff28d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:35.055244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1487f31-11f3-42c4-af0e-642858ff28d6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:35.055528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1487f31-11f3-42c4-af0e-642858ff28d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:35.055802 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1487f31-11f3-42c4-af0e-642858ff28d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:35.056540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1487f31-11f3-42c4-af0e-642858ff28d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:35.056848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1487f31-11f3-42c4-af0e-642858ff28d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:35.060012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1487f31-11f3-42c4-af0e-642858ff28d6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:35.071766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 536/1076] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:35.077344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1487f31-11f3-42c4-af0e-642858ff28d6 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:35.087656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:35.117454 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c764f4d-05b6-43fd-b990-ae92125cd544 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:35.153189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5c27e-0e7c-48ee-ae35-884317fdfae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:35.153914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c27e-0e7c-48ee-ae35-884317fdfae6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:35.154193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c27e-0e7c-48ee-ae35-884317fdfae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:35.154511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c27e-0e7c-48ee-ae35-884317fdfae6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:35.164887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5c27e-0e7c-48ee-ae35-884317fdfae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a3b5c27e-0e7c-48ee-ae35-884317fdfae6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:35.172898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:35.173906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:35.174990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 541/1077] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:35.175908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1487f31-11f3-42c4-af0e-642858ff28d6 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:35.175908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:35.180477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5c27e-0e7c-48ee-ae35-884317fdfae6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:35.217461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846642c6-8281-477a-86c8-c7fa3c53a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:35.218414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846642c6-8281-477a-86c8-c7fa3c53a021 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:35.218706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846642c6-8281-477a-86c8-c7fa3c53a021 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:35.218964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846642c6-8281-477a-86c8-c7fa3c53a021 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:35.226416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846642c6-8281-477a-86c8-c7fa3c53a021 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:35.227875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846642c6-8281-477a-86c8-c7fa3c53a021 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-846642c6-8281-477a-86c8-c7fa3c53a021 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:05:35.243021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:35.243881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:35.244866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:05:35.244866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:05:35.244866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:05:35.244866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:05:35.244866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:05:35.244866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:05:35.244866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:35.244866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:35.244866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 537/1078] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:35.250090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846642c6-8281-477a-86c8-c7fa3c53a021 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:35.288069 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5c27e-0e7c-48ee-ae35-884317fdfae6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:35.316962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:35.323656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337fd8-cac6-4aed-b057-f714ee281fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:35.324361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337fd8-cac6-4aed-b057-f714ee281fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:35.324639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337fd8-cac6-4aed-b057-f714ee281fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:35.324907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337fd8-cac6-4aed-b057-f714ee281fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:35.325641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3337fd8-cac6-4aed-b057-f714ee281fe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:35.325962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3337fd8-cac6-4aed-b057-f714ee281fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:35.327375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3337fd8-cac6-4aed-b057-f714ee281fe2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:35.336531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 542/1079] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:35.342175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337fd8-cac6-4aed-b057-f714ee281fe2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:35.350460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846642c6-8281-477a-86c8-c7fa3c53a021 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:35.385311 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b120fc-dae9-4a97-9023-bca9e61f6a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:35.385973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b120fc-dae9-4a97-9023-bca9e61f6a16 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:35.386248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b120fc-dae9-4a97-9023-bca9e61f6a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:35.386540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b120fc-dae9-4a97-9023-bca9e61f6a16 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:35.387318 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b120fc-dae9-4a97-9023-bca9e61f6a16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:35.387620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b120fc-dae9-4a97-9023-bca9e61f6a16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:35.389041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b120fc-dae9-4a97-9023-bca9e61f6a16 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:35.401873 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 538/1080] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:35.408063 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b120fc-dae9-4a97-9023-bca9e61f6a16 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:35.432119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:35.444563 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337fd8-cac6-4aed-b057-f714ee281fe2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:35.477343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597615-1114-4b59-8ca1-94b741c60f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:35.478235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597615-1114-4b59-8ca1-94b741c60f2e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:35.478541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597615-1114-4b59-8ca1-94b741c60f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:35.478817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597615-1114-4b59-8ca1-94b741c60f2e None admin] PATH_INFO: `/v3/users/e3ed095db7b24bdc99e5fa6bde81edc9` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:35.480011 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84597615-1114-4b59-8ca1-94b741c60f2e None admin] RBAC: Authorizing `identity:get_user(user_id=e3ed095db7b24bdc99e5fa6bde81edc9)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:35.481447 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84597615-1114-4b59-8ca1-94b741c60f2e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:35.483140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 543/1081] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:05:35 2022] GET /identity/v3/users/e3ed095db7b24bdc99e5fa6bde81edc9 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:35.489751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597615-1114-4b59-8ca1-94b741c60f2e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:35.509680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b120fc-dae9-4a97-9023-bca9e61f6a16 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:35.545269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3173-d0cc-4795-85ef-1da83777dd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:35.546175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3173-d0cc-4795-85ef-1da83777dd6a None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:35.546650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3173-d0cc-4795-85ef-1da83777dd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:35.546915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3173-d0cc-4795-85ef-1da83777dd6a None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/b1868e9d8b004c4fb781e532c775428e/roles/421505fc5382430bb34c838f9ac50c45` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:35.549137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a3173-d0cc-4795-85ef-1da83777dd6a None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=b1868e9d8b004c4fb781e532c775428e, role_id=421505fc5382430bb34c838f9ac50c45)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:35.549466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:35.550590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a3173-d0cc-4795-85ef-1da83777dd6a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:35.564186 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 539/1082] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:05:35 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/b1868e9d8b004c4fb781e532c775428e/roles/421505fc5382430bb34c838f9ac50c45 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:05:35.601327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597615-1114-4b59-8ca1-94b741c60f2e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:35.639967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab520edf-3a0a-4c2d-b191-1b3c62055f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:35.641574 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab520edf-3a0a-4c2d-b191-1b3c62055f7d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:35.641849 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab520edf-3a0a-4c2d-b191-1b3c62055f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:35.642121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab520edf-3a0a-4c2d-b191-1b3c62055f7d None admin] PATH_INFO: `/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:35.643458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab520edf-3a0a-4c2d-b191-1b3c62055f7d None admin] RBAC: Authorizing `identity:get_project(project_id=1ae0cf635ef54cbf9f377d6cb4599504)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:35.644921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab520edf-3a0a-4c2d-b191-1b3c62055f7d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:35.646752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 544/1083] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:05:35 2022] GET /identity/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:35.652994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3173-d0cc-4795-85ef-1da83777dd6a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:35.744894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:35.763942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3173-d0cc-4795-85ef-1da83777dd6a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:35.797675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f72ce-1c9e-457a-a0f8-ba8f5d95764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:35.798614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f72ce-1c9e-457a-a0f8-ba8f5d95764d None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:35.798895 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f72ce-1c9e-457a-a0f8-ba8f5d95764d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:35.799168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f72ce-1c9e-457a-a0f8-ba8f5d95764d None admin] PATH_INFO: `/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504/users/e3ed095db7b24bdc99e5fa6bde81edc9/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:35.801214 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f72ce-1c9e-457a-a0f8-ba8f5d95764d None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae0cf635ef54cbf9f377d6cb4599504, user_id=e3ed095db7b24bdc99e5fa6bde81edc9, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:35.802676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f72ce-1c9e-457a-a0f8-ba8f5d95764d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:35.816725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 540/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:05:35 2022] PUT /identity/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504/users/e3ed095db7b24bdc99e5fa6bde81edc9/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:05:37.560007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f99e37-245c-4584-9f4e-5f85bad79916 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:37.560627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f99e37-245c-4584-9f4e-5f85bad79916 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:37.560627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f99e37-245c-4584-9f4e-5f85bad79916 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:37.561904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 545/1085] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:37.567504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b9ddc-dfad-4ab6-8625-98ea14607b5b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:37.567977 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b9ddc-dfad-4ab6-8625-98ea14607b5b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:37.568075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b9ddc-dfad-4ab6-8625-98ea14607b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:37.586102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-ff5b9ddc-dfad-4ab6-8625-98ea14607b5b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:37.587318 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ff5b9ddc-dfad-4ab6-8625-98ea14607b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:37.655110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 541/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:37.678772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f99e37-245c-4584-9f4e-5f85bad79916 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:37.784608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f99e37-245c-4584-9f4e-5f85bad79916 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:37.803712 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32054f-41c0-42a6-be42-bf5568da7f43 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:37.803978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32054f-41c0-42a6-be42-bf5568da7f43 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:37.804283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32054f-41c0-42a6-be42-bf5568da7f43 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:37.805825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 542/1087] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:05:37.810998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798eef6-d3ae-4bcc-9f50-2b09e96dcab4 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:37.811160 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798eef6-d3ae-4bcc-9f50-2b09e96dcab4 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:37.811440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798eef6-d3ae-4bcc-9f50-2b09e96dcab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:37.814263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:37.821559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f47d5a-4ebe-4c21-a587-a68fd40ccf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:37.822430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47d5a-4ebe-4c21-a587-a68fd40ccf46 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:37.822713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47d5a-4ebe-4c21-a587-a68fd40ccf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:37.822987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47d5a-4ebe-4c21-a587-a68fd40ccf46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:37.829925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-0798eef6-d3ae-4bcc-9f50-2b09e96dcab4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:37.831156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-0798eef6-d3ae-4bcc-9f50-2b09e96dcab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:37.834211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f47d5a-4ebe-4c21-a587-a68fd40ccf46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d5f47d5a-4ebe-4c21-a587-a68fd40ccf46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:37.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:37.843647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:37.844569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 546/1088] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Jun 28 03:05:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:37.849892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f47d5a-4ebe-4c21-a587-a68fd40ccf46 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:37.902270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 543/1089] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:05:37.926216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798eef6-d3ae-4bcc-9f50-2b09e96dcab4 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:37.928317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:37.951749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f47d5a-4ebe-4c21-a587-a68fd40ccf46 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:37.985618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fb400-61fe-43d8-9a80-0077d5b0a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:37.986320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb400-61fe-43d8-9a80-0077d5b0a272 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:37.986601 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb400-61fe-43d8-9a80-0077d5b0a272 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:37.986887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fb400-61fe-43d8-9a80-0077d5b0a272 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:37.987646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fb400-61fe-43d8-9a80-0077d5b0a272 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:37.987948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fb400-61fe-43d8-9a80-0077d5b0a272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:37.989694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fb400-61fe-43d8-9a80-0077d5b0a272 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:37.997622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 547/1090] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Jun 28 03:05:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:38.004516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fb400-61fe-43d8-9a80-0077d5b0a272 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:38.028581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798eef6-d3ae-4bcc-9f50-2b09e96dcab4 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:38.059971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:38.069913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492d4fc-8206-4a75-a2fc-ac490bf14666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:38.070716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492d4fc-8206-4a75-a2fc-ac490bf14666 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:38.071003 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492d4fc-8206-4a75-a2fc-ac490bf14666 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:38.071278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492d4fc-8206-4a75-a2fc-ac490bf14666 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:38.081519 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492d4fc-8206-4a75-a2fc-ac490bf14666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-3492d4fc-8206-4a75-a2fc-ac490bf14666 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:38.089179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:38.090204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:38.091101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 544/1091] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:05:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:38.096620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492d4fc-8206-4a75-a2fc-ac490bf14666 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:38.106890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fb400-61fe-43d8-9a80-0077d5b0a272 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:38.140370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664ce08-0883-481a-8697-c7db082a3011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:38.141374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664ce08-0883-481a-8697-c7db082a3011 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:38.141647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664ce08-0883-481a-8697-c7db082a3011 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:38.141901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664ce08-0883-481a-8697-c7db082a3011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:38.152405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664ce08-0883-481a-8697-c7db082a3011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:38.153866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664ce08-0883-481a-8697-c7db082a3011 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:38.157239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-0664ce08-0883-481a-8697-c7db082a3011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:38.171072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:38.172117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:38.173253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:38.173253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:38.173253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:38.173253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:38.173253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 548/1092] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:38.177982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664ce08-0883-481a-8697-c7db082a3011 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:38.198696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492d4fc-8206-4a75-a2fc-ac490bf14666 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:38.231049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770c5c-6b0d-48e6-b766-55dec1642561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:38.231728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770c5c-6b0d-48e6-b766-55dec1642561 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:38.232025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770c5c-6b0d-48e6-b766-55dec1642561 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:38.232323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770c5c-6b0d-48e6-b766-55dec1642561 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:38.233064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8770c5c-6b0d-48e6-b766-55dec1642561 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:38.233371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8770c5c-6b0d-48e6-b766-55dec1642561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:38.234929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8770c5c-6b0d-48e6-b766-55dec1642561 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:38.243397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 545/1093] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:05:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:38.249134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770c5c-6b0d-48e6-b766-55dec1642561 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:38.275939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664ce08-0883-481a-8697-c7db082a3011 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:38.278020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:38.311234 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b140e-edb0-40ce-8c27-b773a794f4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:38.311889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b140e-edb0-40ce-8c27-b773a794f4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:38.312394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b140e-edb0-40ce-8c27-b773a794f4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:38.313000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b140e-edb0-40ce-8c27-b773a794f4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:38.313800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b140e-edb0-40ce-8c27-b773a794f4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:38.314088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b140e-edb0-40ce-8c27-b773a794f4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:38.315503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b140e-edb0-40ce-8c27-b773a794f4a5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:38.326767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 549/1094] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:38.332567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b140e-edb0-40ce-8c27-b773a794f4a5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:38.357899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770c5c-6b0d-48e6-b766-55dec1642561 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:38.381394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:38.393656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd8f7-527c-4917-9be7-5172910bdc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:38.394569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd8f7-527c-4917-9be7-5172910bdc5c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:38.394844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd8f7-527c-4917-9be7-5172910bdc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:38.395109 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd8f7-527c-4917-9be7-5172910bdc5c None admin] PATH_INFO: `/v3/users/e3ed095db7b24bdc99e5fa6bde81edc9` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:38.396314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddd8f7-527c-4917-9be7-5172910bdc5c None admin] RBAC: Authorizing `identity:get_user(user_id=e3ed095db7b24bdc99e5fa6bde81edc9)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:38.397751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddd8f7-527c-4917-9be7-5172910bdc5c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:38.399459 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 546/1095] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:05:38 2022] GET /identity/v3/users/e3ed095db7b24bdc99e5fa6bde81edc9 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:38.405030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd8f7-527c-4917-9be7-5172910bdc5c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:38.438900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b140e-edb0-40ce-8c27-b773a794f4a5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:38.471725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96c8c-0b95-4843-b782-4232997fe785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:38.472523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96c8c-0b95-4843-b782-4232997fe785 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:38.472800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96c8c-0b95-4843-b782-4232997fe785 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:38.473066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96c8c-0b95-4843-b782-4232997fe785 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:38.480505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96c8c-0b95-4843-b782-4232997fe785 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:38.481951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96c8c-0b95-4843-b782-4232997fe785 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-57d96c8c-0b95-4843-b782-4232997fe785 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:05:38.496270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:38.497440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:38.498498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:38.498498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:38.498498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:05:38.498498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:05:38.498498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:05:38.498498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:05:38.498498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:05:38.498498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:05:38.498498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 03:05:38.498498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:38.498498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 550/1096] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Jun 28 03:05:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:38.503695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96c8c-0b95-4843-b782-4232997fe785 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:38.509944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd8f7-527c-4917-9be7-5172910bdc5c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:38.529809 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:38.543402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72e714-31ca-4ffb-b0fa-6b03f802a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:38.544055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72e714-31ca-4ffb-b0fa-6b03f802a84a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:38.544334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72e714-31ca-4ffb-b0fa-6b03f802a84a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:38.544604 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72e714-31ca-4ffb-b0fa-6b03f802a84a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:38.602234 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:38.604761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96c8c-0b95-4843-b782-4232997fe785 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:38.613630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72e714-31ca-4ffb-b0fa-6b03f802a84a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:38.615487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72e714-31ca-4ffb-b0fa-6b03f802a84a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:38.640238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049304c-e862-4833-a9a8-4079b0b397fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:38.640987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049304c-e862-4833-a9a8-4079b0b397fe None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:38.641180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049304c-e862-4833-a9a8-4079b0b397fe None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:38.641455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049304c-e862-4833-a9a8-4079b0b397fe None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:38.642282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049304c-e862-4833-a9a8-4079b0b397fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:38.642611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049304c-e862-4833-a9a8-4079b0b397fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:38.644046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049304c-e862-4833-a9a8-4079b0b397fe None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:38.663224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 551/1097] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Jun 28 03:05:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:38.669086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049304c-e862-4833-a9a8-4079b0b397fe None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:38.720936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 547/1098] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 28 03:05:38.726739 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72e714-31ca-4ffb-b0fa-6b03f802a84a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:38.750374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:38.769104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049304c-e862-4833-a9a8-4079b0b397fe None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:38.804837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59122b-825f-45a3-865a-8c0ae2b35f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:38.805496 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59122b-825f-45a3-865a-8c0ae2b35f26 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:38.805777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59122b-825f-45a3-865a-8c0ae2b35f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:38.806051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59122b-825f-45a3-865a-8c0ae2b35f26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:38.818584 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:38.828276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72e714-31ca-4ffb-b0fa-6b03f802a84a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:38.862844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812108c9-d816-4f6e-85ad-3b77d5a97048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:38.863726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812108c9-d816-4f6e-85ad-3b77d5a97048 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:38.864388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812108c9-d816-4f6e-85ad-3b77d5a97048 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:38.864642 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812108c9-d816-4f6e-85ad-3b77d5a97048 None admin] PATH_INFO: `/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:38.865822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812108c9-d816-4f6e-85ad-3b77d5a97048 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae0cf635ef54cbf9f377d6cb4599504)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:38.867281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812108c9-d816-4f6e-85ad-3b77d5a97048 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:38.869006 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 548/1099] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:05:38 2022] GET /identity/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:38.875118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812108c9-d816-4f6e-85ad-3b77d5a97048 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:38.880015 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59122b-825f-45a3-865a-8c0ae2b35f26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:38.881487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59122b-825f-45a3-865a-8c0ae2b35f26 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:38.961546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:38.971998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812108c9-d816-4f6e-85ad-3b77d5a97048 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:38.980383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 552/1100] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:05:38.986243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59122b-825f-45a3-865a-8c0ae2b35f26 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:39.006792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147821c5-6d53-431e-b777-6c0700a33112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:39.007457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147821c5-6d53-431e-b777-6c0700a33112 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:39.007739 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147821c5-6d53-431e-b777-6c0700a33112 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:39.008011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147821c5-6d53-431e-b777-6c0700a33112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:39.008842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147821c5-6d53-431e-b777-6c0700a33112 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=1ae0cf635ef54cbf9f377d6cb4599504, user.id=e3ed095db7b24bdc99e5fa6bde81edc9) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:39.009155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147821c5-6d53-431e-b777-6c0700a33112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:39.010606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147821c5-6d53-431e-b777-6c0700a33112 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:39.016615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 549/1101] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:38 2022] GET /identity/v3/role_assignments?user.id=e3ed095db7b24bdc99e5fa6bde81edc9&scope.project.id=1ae0cf635ef54cbf9f377d6cb4599504&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:39.097096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59122b-825f-45a3-865a-8c0ae2b35f26 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:39.135101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de41c4-85df-44bb-bc1d-80f5020b22a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:39.135828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de41c4-85df-44bb-bc1d-80f5020b22a6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:39.136105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de41c4-85df-44bb-bc1d-80f5020b22a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:39.136377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de41c4-85df-44bb-bc1d-80f5020b22a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:39.148371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de41c4-85df-44bb-bc1d-80f5020b22a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:39.149875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de41c4-85df-44bb-bc1d-80f5020b22a6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-71de41c4-85df-44bb-bc1d-80f5020b22a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:05:39.169189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:39.170258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:39.171400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:05:39.171400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:05:39.171400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:05:39.171400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:39.171400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 553/1102] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:05:39.177291 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147821c5-6d53-431e-b777-6c0700a33112 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:39.207026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:39.284605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147821c5-6d53-431e-b777-6c0700a33112 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:39.317557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c1b8-2b9e-4c2f-b65a-7263d9d99719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:39.318223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c1b8-2b9e-4c2f-b65a-7263d9d99719 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:39.318527 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c1b8-2b9e-4c2f-b65a-7263d9d99719 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:39.318802 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c1b8-2b9e-4c2f-b65a-7263d9d99719 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:39.319524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c1b8-2b9e-4c2f-b65a-7263d9d99719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:39.319831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c1b8-2b9e-4c2f-b65a-7263d9d99719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:39.321209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c1b8-2b9e-4c2f-b65a-7263d9d99719 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:39.333211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 550/1103] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:39.339140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de41c4-85df-44bb-bc1d-80f5020b22a6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:39.375429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:39.442185 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de41c4-85df-44bb-bc1d-80f5020b22a6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:39.477746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2584448-6cbd-4f08-bd4c-67a95dae1869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:39.478589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584448-6cbd-4f08-bd4c-67a95dae1869 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:39.478870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584448-6cbd-4f08-bd4c-67a95dae1869 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:39.479143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584448-6cbd-4f08-bd4c-67a95dae1869 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:39.486495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2584448-6cbd-4f08-bd4c-67a95dae1869 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:39.487960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2584448-6cbd-4f08-bd4c-67a95dae1869 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a2584448-6cbd-4f08-bd4c-67a95dae1869 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:05:39.502534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:39.503470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:39.504365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:05:39.504365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:05:39.504365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:05:39.504365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:05:39.504365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:05:39.504365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:05:39.504365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:05:39.504365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:05:39.506490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 554/1104] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:39.509854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c1b8-2b9e-4c2f-b65a-7263d9d99719 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:39.596485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:39.612789 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c1b8-2b9e-4c2f-b65a-7263d9d99719 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:39.646917 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04ff9e-ac74-4aa3-a432-3e761cf9de4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:39.647584 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04ff9e-ac74-4aa3-a432-3e761cf9de4f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:39.647861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04ff9e-ac74-4aa3-a432-3e761cf9de4f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:39.648127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04ff9e-ac74-4aa3-a432-3e761cf9de4f None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:39.648911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04ff9e-ac74-4aa3-a432-3e761cf9de4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:39.649214 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04ff9e-ac74-4aa3-a432-3e761cf9de4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:39.650679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04ff9e-ac74-4aa3-a432-3e761cf9de4f None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:39.663231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 551/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:05:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:39.670418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2584448-6cbd-4f08-bd4c-67a95dae1869 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:39.767316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:39.774575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2584448-6cbd-4f08-bd4c-67a95dae1869 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:39.807205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf9a57-fdd7-4f46-87ee-96ac069e72d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:39.807862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf9a57-fdd7-4f46-87ee-96ac069e72d8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:39.808136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf9a57-fdd7-4f46-87ee-96ac069e72d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:39.808410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf9a57-fdd7-4f46-87ee-96ac069e72d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:39.809229 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf9a57-fdd7-4f46-87ee-96ac069e72d8 None admin] RBAC: Adding query filter params (role.id=421505fc5382430bb34c838f9ac50c45, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=b1868e9d8b004c4fb781e532c775428e) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:39.809537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf9a57-fdd7-4f46-87ee-96ac069e72d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:39.810996 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf9a57-fdd7-4f46-87ee-96ac069e72d8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:39.817457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 555/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:39 2022] GET /identity/v3/role_assignments?user.id=b1868e9d8b004c4fb781e532c775428e&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=421505fc5382430bb34c838f9ac50c45 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:41.097576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88b3d7-aa54-45f0-9cd3-00e3a1bf9772 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:41.098403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88b3d7-aa54-45f0-9cd3-00e3a1bf9772 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:41.098581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88b3d7-aa54-45f0-9cd3-00e3a1bf9772 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:41.100721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 552/1107] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:41.106031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e46d9-94aa-4e2b-aac5-eb21e5c4a949 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:41.106483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e46d9-94aa-4e2b-aac5-eb21e5c4a949 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:41.106601 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e46d9-94aa-4e2b-aac5-eb21e5c4a949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:41.126247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-282e46d9-94aa-4e2b-aac5-eb21e5c4a949 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:41.127456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-282e46d9-94aa-4e2b-aac5-eb21e5c4a949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:41.198946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 556/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:41.225284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88b3d7-aa54-45f0-9cd3-00e3a1bf9772 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:41.338695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88b3d7-aa54-45f0-9cd3-00e3a1bf9772 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:41.372809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287cf8b-6787-4760-ba62-e869d795c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:41.373596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287cf8b-6787-4760-ba62-e869d795c928 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:41.373868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287cf8b-6787-4760-ba62-e869d795c928 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:41.374492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287cf8b-6787-4760-ba62-e869d795c928 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:41.375783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287cf8b-6787-4760-ba62-e869d795c928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:41.377209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287cf8b-6787-4760-ba62-e869d795c928 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:41.378871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 553/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:41.385559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e46d9-94aa-4e2b-aac5-eb21e5c4a949 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:41.482859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:41.495797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e46d9-94aa-4e2b-aac5-eb21e5c4a949 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:41.530767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde07db-daf9-4310-bc61-795a71c1b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:41.531430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde07db-daf9-4310-bc61-795a71c1b30e None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:41.531712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde07db-daf9-4310-bc61-795a71c1b30e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:41.531979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde07db-daf9-4310-bc61-795a71c1b30e None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:41.532692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde07db-daf9-4310-bc61-795a71c1b30e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:41.534129 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde07db-daf9-4310-bc61-795a71c1b30e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:41.560683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 557/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:05:41 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:43.597635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c3996-11d5-44ec-960a-e57da2dca5ed None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:43.598267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c3996-11d5-44ec-960a-e57da2dca5ed None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:43.598267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c3996-11d5-44ec-960a-e57da2dca5ed None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:43.600199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 554/1111] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:43.605623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73788563-0c93-4cdc-bdfe-3570916479c1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:43.606087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73788563-0c93-4cdc-bdfe-3570916479c1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:43.606183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73788563-0c93-4cdc-bdfe-3570916479c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:43.625789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-73788563-0c93-4cdc-bdfe-3570916479c1 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:43.627022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-73788563-0c93-4cdc-bdfe-3570916479c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:43.702221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 558/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:43.732207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c3996-11d5-44ec-960a-e57da2dca5ed None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:43.748998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:43.844543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c3996-11d5-44ec-960a-e57da2dca5ed None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:43.883700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0140a-a0dd-40dd-b61a-f8786692c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:43.884987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0140a-a0dd-40dd-b61a-f8786692c2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:43.885419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0140a-a0dd-40dd-b61a-f8786692c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:43.885837 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0140a-a0dd-40dd-b61a-f8786692c2c8 None admin] PATH_INFO: `/v3/roles/66ac9c3671cb46b6ae847fdbc68015b3` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:43.888457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0140a-a0dd-40dd-b61a-f8786692c2c8 None admin] RBAC: Authorizing `identity:get_role(role_id=66ac9c3671cb46b6ae847fdbc68015b3)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:43.890610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0140a-a0dd-40dd-b61a-f8786692c2c8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:43.892658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 555/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:05:43 2022] GET /identity/v3/roles/66ac9c3671cb46b6ae847fdbc68015b3 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:43.899220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73788563-0c93-4cdc-bdfe-3570916479c1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:43.979874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:44.011293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73788563-0c93-4cdc-bdfe-3570916479c1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:44.053736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cc5e3-8017-4fdd-afab-a5cea6d3e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:44.054660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc5e3-8017-4fdd-afab-a5cea6d3e0be None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:44.054942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc5e3-8017-4fdd-afab-a5cea6d3e0be None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:44.055218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc5e3-8017-4fdd-afab-a5cea6d3e0be None admin] PATH_INFO: `/v3/users/1b86429be6ca41459ba9b70a3456df19` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:44.069022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cc5e3-8017-4fdd-afab-a5cea6d3e0be None admin] RBAC: Authorizing `identity:get_user(user_id=1b86429be6ca41459ba9b70a3456df19)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:44.070513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cc5e3-8017-4fdd-afab-a5cea6d3e0be None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:44.072227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 559/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:05:43 2022] GET /identity/v3/users/1b86429be6ca41459ba9b70a3456df19 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:44.078257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0140a-a0dd-40dd-b61a-f8786692c2c8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:44.174699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:44.195327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0140a-a0dd-40dd-b61a-f8786692c2c8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:44.230250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb8abc-0981-4adc-bf79-24fa146b164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:44.230925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb8abc-0981-4adc-bf79-24fa146b164e None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:44.231204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb8abc-0981-4adc-bf79-24fa146b164e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:44.231475 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb8abc-0981-4adc-bf79-24fa146b164e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:44.299897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb8abc-0981-4adc-bf79-24fa146b164e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:44.301343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb8abc-0981-4adc-bf79-24fa146b164e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:44.381421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:44.402474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 556/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:05:44.408659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cc5e3-8017-4fdd-afab-a5cea6d3e0be None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:44.517415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cc5e3-8017-4fdd-afab-a5cea6d3e0be None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:44.547168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:44.553111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48012c-1f58-48a6-93a5-169a1a93c2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:44.553978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48012c-1f58-48a6-93a5-169a1a93c2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:44.554257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48012c-1f58-48a6-93a5-169a1a93c2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:44.554563 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48012c-1f58-48a6-93a5-169a1a93c2a3 None admin] PATH_INFO: `/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:44.555741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48012c-1f58-48a6-93a5-169a1a93c2a3 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae0cf635ef54cbf9f377d6cb4599504)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:44.557180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48012c-1f58-48a6-93a5-169a1a93c2a3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:44.558912 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 560/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:05:44 2022] GET /identity/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:44.565572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb8abc-0981-4adc-bf79-24fa146b164e None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:44.674725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb8abc-0981-4adc-bf79-24fa146b164e None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:44.711519 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fcaa9-d995-41da-80c4-01be279b4ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:44.712175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fcaa9-d995-41da-80c4-01be279b4ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:44.712481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fcaa9-d995-41da-80c4-01be279b4ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:44.712751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fcaa9-d995-41da-80c4-01be279b4ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:44.713581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fcaa9-d995-41da-80c4-01be279b4ed6 None admin] RBAC: Adding query filter params (role.id=66ac9c3671cb46b6ae847fdbc68015b3, scope.project.id=1ae0cf635ef54cbf9f377d6cb4599504, user.id=1b86429be6ca41459ba9b70a3456df19) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:44.713888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fcaa9-d995-41da-80c4-01be279b4ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:44.715344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fcaa9-d995-41da-80c4-01be279b4ed6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:44.721216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 557/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:44 2022] GET /identity/v3/role_assignments?user.id=1b86429be6ca41459ba9b70a3456df19&scope.project.id=1ae0cf635ef54cbf9f377d6cb4599504&role.id=66ac9c3671cb46b6ae847fdbc68015b3 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:46.742214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac99b7-be6d-4de2-9cc8-09670ff80b17 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:46.742835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac99b7-be6d-4de2-9cc8-09670ff80b17 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:46.742835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac99b7-be6d-4de2-9cc8-09670ff80b17 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:46.744171 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 561/1118] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:46.750601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ef7a2-36ff-4581-926d-7dc96e9f04c5 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:46.751243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ef7a2-36ff-4581-926d-7dc96e9f04c5 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:46.751444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ef7a2-36ff-4581-926d-7dc96e9f04c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:46.780356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-c62ef7a2-36ff-4581-926d-7dc96e9f04c5 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:46.781770 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c62ef7a2-36ff-4581-926d-7dc96e9f04c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:46.824562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:46.854018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 558/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:46.877885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac99b7-be6d-4de2-9cc8-09670ff80b17 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:46.988401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac99b7-be6d-4de2-9cc8-09670ff80b17 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:47.023428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d70340-d858-431f-a17e-f27708ad74bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:47.024228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d70340-d858-431f-a17e-f27708ad74bf None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:47.024505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d70340-d858-431f-a17e-f27708ad74bf None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:47.024772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d70340-d858-431f-a17e-f27708ad74bf None admin] PATH_INFO: `/v3/roles/66ac9c3671cb46b6ae847fdbc68015b3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:47.026358 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d70340-d858-431f-a17e-f27708ad74bf None admin] RBAC: Authorizing `identity:get_role(role_id=66ac9c3671cb46b6ae847fdbc68015b3)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:47.027766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d70340-d858-431f-a17e-f27708ad74bf None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:47.029167 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 562/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:05:46 2022] GET /identity/v3/roles/66ac9c3671cb46b6ae847fdbc68015b3 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:47.035874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ef7a2-36ff-4581-926d-7dc96e9f04c5 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:47.142717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ef7a2-36ff-4581-926d-7dc96e9f04c5 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:47.177591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eecf5b-78f9-413f-ba26-c1169a48012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:47.178491 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eecf5b-78f9-413f-ba26-c1169a48012d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:47.178770 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eecf5b-78f9-413f-ba26-c1169a48012d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:47.179040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eecf5b-78f9-413f-ba26-c1169a48012d None admin] PATH_INFO: `/v3/users/1b86429be6ca41459ba9b70a3456df19` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:47.180225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eecf5b-78f9-413f-ba26-c1169a48012d None admin] RBAC: Authorizing `identity:get_user(user_id=1b86429be6ca41459ba9b70a3456df19)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:47.181653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eecf5b-78f9-413f-ba26-c1169a48012d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:47.183326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 559/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:05:47 2022] GET /identity/v3/users/1b86429be6ca41459ba9b70a3456df19 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:47.190355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d70340-d858-431f-a17e-f27708ad74bf None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:47.268045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:47.315492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d70340-d858-431f-a17e-f27708ad74bf None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:47.352306 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad96b2e-a638-45ae-b2d9-92c66f35d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:47.353163 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad96b2e-a638-45ae-b2d9-92c66f35d588 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:47.353439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad96b2e-a638-45ae-b2d9-92c66f35d588 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:47.353706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad96b2e-a638-45ae-b2d9-92c66f35d588 None admin] PATH_INFO: `/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:47.354957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad96b2e-a638-45ae-b2d9-92c66f35d588 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae0cf635ef54cbf9f377d6cb4599504)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:47.356389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad96b2e-a638-45ae-b2d9-92c66f35d588 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:47.358067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 563/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:05:47 2022] GET /identity/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:47.364654 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eecf5b-78f9-413f-ba26-c1169a48012d None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:47.418688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:47.483334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eecf5b-78f9-413f-ba26-c1169a48012d None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:47.519296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05a5e7-cab7-4429-ba59-d7e6cd13d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:47.520181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a5e7-cab7-4429-ba59-d7e6cd13d603 None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:47.520458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a5e7-cab7-4429-ba59-d7e6cd13d603 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:47.520725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a5e7-cab7-4429-ba59-d7e6cd13d603 None admin] PATH_INFO: `/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504/users/1b86429be6ca41459ba9b70a3456df19/roles/66ac9c3671cb46b6ae847fdbc68015b3` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:47.523105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05a5e7-cab7-4429-ba59-d7e6cd13d603 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae0cf635ef54cbf9f377d6cb4599504, user_id=1b86429be6ca41459ba9b70a3456df19, role_id=66ac9c3671cb46b6ae847fdbc68015b3)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:47.524542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05a5e7-cab7-4429-ba59-d7e6cd13d603 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:47.540179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 560/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:05:47 2022] PUT /identity/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504/users/1b86429be6ca41459ba9b70a3456df19/roles/66ac9c3671cb46b6ae847fdbc68015b3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:05:49.615342 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521549f-cdc8-4dbb-99d3-bd2eed6d13f9 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:49.615902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521549f-cdc8-4dbb-99d3-bd2eed6d13f9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:49.615902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521549f-cdc8-4dbb-99d3-bd2eed6d13f9 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:49.617259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 564/1124] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:49.623675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7084a-9b67-4916-8f5b-7b871b715ead None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:49.624396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7084a-9b67-4916-8f5b-7b871b715ead None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:49.624770 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7084a-9b67-4916-8f5b-7b871b715ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:49.644257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-cbd7084a-9b67-4916-8f5b-7b871b715ead None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:49.645455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cbd7084a-9b67-4916-8f5b-7b871b715ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:49.721332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 561/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:49.752245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521549f-cdc8-4dbb-99d3-bd2eed6d13f9 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:49.860466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521549f-cdc8-4dbb-99d3-bd2eed6d13f9 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:49.900328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e695-8bfa-4ed7-af7d-fbd7d80747c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:49.901128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e695-8bfa-4ed7-af7d-fbd7d80747c1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:49.901409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e695-8bfa-4ed7-af7d-fbd7d80747c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:49.901677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e695-8bfa-4ed7-af7d-fbd7d80747c1 None admin] PATH_INFO: `/v3/roles/66ac9c3671cb46b6ae847fdbc68015b3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:49.903209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272e695-8bfa-4ed7-af7d-fbd7d80747c1 None admin] RBAC: Authorizing `identity:get_role(role_id=66ac9c3671cb46b6ae847fdbc68015b3)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:49.904596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272e695-8bfa-4ed7-af7d-fbd7d80747c1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:49.906046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 565/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:05:49 2022] GET /identity/v3/roles/66ac9c3671cb46b6ae847fdbc68015b3 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:49.912221 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7084a-9b67-4916-8f5b-7b871b715ead None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:49.947697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:50.031609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7084a-9b67-4916-8f5b-7b871b715ead None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:50.081671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bc9a7-7f0d-4423-8048-4d8235d219c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:50.082601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bc9a7-7f0d-4423-8048-4d8235d219c1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:50.082886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bc9a7-7f0d-4423-8048-4d8235d219c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:50.083162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bc9a7-7f0d-4423-8048-4d8235d219c1 None admin] PATH_INFO: `/v3/users/1b86429be6ca41459ba9b70a3456df19` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:50.084481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bc9a7-7f0d-4423-8048-4d8235d219c1 None admin] RBAC: Authorizing `identity:get_user(user_id=1b86429be6ca41459ba9b70a3456df19)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:50.085927 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bc9a7-7f0d-4423-8048-4d8235d219c1 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:50.087639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 562/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:05:49 2022] GET /identity/v3/users/1b86429be6ca41459ba9b70a3456df19 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:50.094540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e695-8bfa-4ed7-af7d-fbd7d80747c1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:50.100661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:50.211115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e695-8bfa-4ed7-af7d-fbd7d80747c1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:50.245889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ddbbc-74ec-4f6d-88bb-62b93198c7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:50.246565 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ddbbc-74ec-4f6d-88bb-62b93198c7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:50.246850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ddbbc-74ec-4f6d-88bb-62b93198c7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:50.247114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ddbbc-74ec-4f6d-88bb-62b93198c7e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:50.315256 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ddbbc-74ec-4f6d-88bb-62b93198c7e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:50.316702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ddbbc-74ec-4f6d-88bb-62b93198c7e6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:50.319317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:50.438702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 566/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:05:50.444859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bc9a7-7f0d-4423-8048-4d8235d219c1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:50.558276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:50.561989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bc9a7-7f0d-4423-8048-4d8235d219c1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:50.597477 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d8125-6c50-48a8-a415-453c5e5a778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:50.598338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d8125-6c50-48a8-a415-453c5e5a778c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:50.598659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d8125-6c50-48a8-a415-453c5e5a778c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:50.598939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d8125-6c50-48a8-a415-453c5e5a778c None admin] PATH_INFO: `/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:50.600174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d8125-6c50-48a8-a415-453c5e5a778c None admin] RBAC: Authorizing `identity:get_project(project_id=1ae0cf635ef54cbf9f377d6cb4599504)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:50.601612 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d8125-6c50-48a8-a415-453c5e5a778c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:50.603370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 563/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:05:50 2022] GET /identity/v3/projects/1ae0cf635ef54cbf9f377d6cb4599504 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:50.610197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ddbbc-74ec-4f6d-88bb-62b93198c7e6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:50.725291 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ddbbc-74ec-4f6d-88bb-62b93198c7e6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:50.727648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:50.775298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e61232-5cf7-4bb3-a480-89d8c089f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:50.775976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e61232-5cf7-4bb3-a480-89d8c089f8dd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:50.776256 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e61232-5cf7-4bb3-a480-89d8c089f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:50.776527 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e61232-5cf7-4bb3-a480-89d8c089f8dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:50.777366 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e61232-5cf7-4bb3-a480-89d8c089f8dd None admin] RBAC: Adding query filter params (role.id=66ac9c3671cb46b6ae847fdbc68015b3, scope.project.id=1ae0cf635ef54cbf9f377d6cb4599504, user.id=1b86429be6ca41459ba9b70a3456df19) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:50.777679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e61232-5cf7-4bb3-a480-89d8c089f8dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:50.779160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e61232-5cf7-4bb3-a480-89d8c089f8dd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:50.785476 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 567/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:50 2022] GET /identity/v3/role_assignments?user.id=1b86429be6ca41459ba9b70a3456df19&scope.project.id=1ae0cf635ef54cbf9f377d6cb4599504&role.id=66ac9c3671cb46b6ae847fdbc68015b3 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:52.831774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5fc09-ebd8-44bd-a2c2-419593019e25 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:52.832669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5fc09-ebd8-44bd-a2c2-419593019e25 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:52.832669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5fc09-ebd8-44bd-a2c2-419593019e25 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:52.834942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 564/1131] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:52.841200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a4713-3783-46c4-86e7-9d1eb2f4eb1b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:52.841629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a4713-3783-46c4-86e7-9d1eb2f4eb1b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:52.841761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a4713-3783-46c4-86e7-9d1eb2f4eb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:52.860261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d05a4713-3783-46c4-86e7-9d1eb2f4eb1b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:52.861447 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d05a4713-3783-46c4-86e7-9d1eb2f4eb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:52.935972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 568/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:52.960048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5fc09-ebd8-44bd-a2c2-419593019e25 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:53.083067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5fc09-ebd8-44bd-a2c2-419593019e25 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:53.118371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d26e60-600c-469b-aad2-973d08236cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:53.119165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26e60-600c-469b-aad2-973d08236cde None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:53.119444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26e60-600c-469b-aad2-973d08236cde None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:53.119716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26e60-600c-469b-aad2-973d08236cde None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:53.120990 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d26e60-600c-469b-aad2-973d08236cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:53.122438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d26e60-600c-469b-aad2-973d08236cde None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:53.124121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 565/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:53.133431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a4713-3783-46c4-86e7-9d1eb2f4eb1b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:53.241004 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:53.245049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a4713-3783-46c4-86e7-9d1eb2f4eb1b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:53.281478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8170c6-dfb1-442b-8e8e-3e048c8e65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:53.282138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8170c6-dfb1-442b-8e8e-3e048c8e65e1 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:53.282457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8170c6-dfb1-442b-8e8e-3e048c8e65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:53.282731 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8170c6-dfb1-442b-8e8e-3e048c8e65e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:53.283439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8170c6-dfb1-442b-8e8e-3e048c8e65e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:53.284889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8170c6-dfb1-442b-8e8e-3e048c8e65e1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:53.313242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 569/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:05:53 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:55.345947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ff07-7825-4926-b89a-7b41408eb863 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:55.346822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ff07-7825-4926-b89a-7b41408eb863 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:55.346822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ff07-7825-4926-b89a-7b41408eb863 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:55.348925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 566/1135] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:55.356829 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1023c2-2538-44ff-8cf7-8025dda03d8b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:55.357258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1023c2-2538-44ff-8cf7-8025dda03d8b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:55.357364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1023c2-2538-44ff-8cf7-8025dda03d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:55.375254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9f1023c2-2538-44ff-8cf7-8025dda03d8b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:55.376426 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9f1023c2-2538-44ff-8cf7-8025dda03d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:55.447771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 570/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:55.472809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49ff07-7825-4926-b89a-7b41408eb863 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:55.515780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:55.607358 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49ff07-7825-4926-b89a-7b41408eb863 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:55.642853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9ec51-88a0-4a13-be77-bf94c053ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:55.643648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9ec51-88a0-4a13-be77-bf94c053ede8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:55.643927 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9ec51-88a0-4a13-be77-bf94c053ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:55.644195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9ec51-88a0-4a13-be77-bf94c053ede8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:55.645482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9ec51-88a0-4a13-be77-bf94c053ede8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:55.646960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9ec51-88a0-4a13-be77-bf94c053ede8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:55.648577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 567/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:05:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:55.655032 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1023c2-2538-44ff-8cf7-8025dda03d8b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:55.747830 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:55.779134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1023c2-2538-44ff-8cf7-8025dda03d8b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:55.815579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738125d2-e89b-4313-ab78-8e42f4767542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:55.816247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738125d2-e89b-4313-ab78-8e42f4767542 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:55.816525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738125d2-e89b-4313-ab78-8e42f4767542 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:55.816800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738125d2-e89b-4313-ab78-8e42f4767542 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:55.817505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738125d2-e89b-4313-ab78-8e42f4767542 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:55.818989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738125d2-e89b-4313-ab78-8e42f4767542 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:55.843748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 571/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:05:55 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:05:57.906707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0328f-020b-4458-8066-f21bd9775476 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:57.907282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0328f-020b-4458-8066-f21bd9775476 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:57.907282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0328f-020b-4458-8066-f21bd9775476 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:57.908662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 568/1139] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:05:57.915101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0727c-12d8-488f-a72f-18e33cc56eff None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:57.915822 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0727c-12d8-488f-a72f-18e33cc56eff None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:57.915965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0727c-12d8-488f-a72f-18e33cc56eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:57.942104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-46a0727c-12d8-488f-a72f-18e33cc56eff None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:05:57.943326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-46a0727c-12d8-488f-a72f-18e33cc56eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:05:58.012704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 572/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:05:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:05:58.043408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0328f-020b-4458-8066-f21bd9775476 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:58.169031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0328f-020b-4458-8066-f21bd9775476 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:58.173522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:58.213743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a8b4c-602d-4cbb-9123-f256d74323d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:58.214569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a8b4c-602d-4cbb-9123-f256d74323d8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:58.214847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a8b4c-602d-4cbb-9123-f256d74323d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:58.215142 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a8b4c-602d-4cbb-9123-f256d74323d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:58.226143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a8b4c-602d-4cbb-9123-f256d74323d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-e84a8b4c-602d-4cbb-9123-f256d74323d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:05:58.234342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:05:58.235493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:05:58.237424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 569/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:05:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:05:58.245776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0727c-12d8-488f-a72f-18e33cc56eff None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:58.322538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:58.358428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0727c-12d8-488f-a72f-18e33cc56eff None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:58.394447 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a260d-95c7-4384-9e45-d0e845595d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:58.395121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a260d-95c7-4384-9e45-d0e845595d45 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:58.395408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a260d-95c7-4384-9e45-d0e845595d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:58.395680 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a260d-95c7-4384-9e45-d0e845595d45 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:58.396433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a260d-95c7-4384-9e45-d0e845595d45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:58.396740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a260d-95c7-4384-9e45-d0e845595d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:58.398128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a260d-95c7-4384-9e45-d0e845595d45 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:58.406717 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 573/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:05:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:05:58.415898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a8b4c-602d-4cbb-9123-f256d74323d8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:58.526319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a8b4c-602d-4cbb-9123-f256d74323d8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:58.561342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b9316-a718-4389-95d6-d0ae2416682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:58.562239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9316-a718-4389-95d6-d0ae2416682b None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:58.562551 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9316-a718-4389-95d6-d0ae2416682b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:58.562821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9316-a718-4389-95d6-d0ae2416682b None admin] PATH_INFO: `/v3/users/3c8282a09d6b4dd8863ad6236ab34559` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:58.577935 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b9316-a718-4389-95d6-d0ae2416682b None admin] RBAC: Authorizing `identity:get_user(user_id=3c8282a09d6b4dd8863ad6236ab34559)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:58.579511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b9316-a718-4389-95d6-d0ae2416682b None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:58.581167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 570/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:05:58 2022] GET /identity/v3/users/3c8282a09d6b4dd8863ad6236ab34559 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:58.590260 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a260d-95c7-4384-9e45-d0e845595d45 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:58.701579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a260d-95c7-4384-9e45-d0e845595d45 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:58.737446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:58.751236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d5954-abe4-40ac-819d-f73d3e9595d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:58.751898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5954-abe4-40ac-819d-f73d3e9595d6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:58.752176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5954-abe4-40ac-819d-f73d3e9595d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:58.752444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5954-abe4-40ac-819d-f73d3e9595d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:58.821850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d5954-abe4-40ac-819d-f73d3e9595d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:58.823257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d5954-abe4-40ac-819d-f73d3e9595d6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:58.934975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 574/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:05:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:05:58.941708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b9316-a718-4389-95d6-d0ae2416682b None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:58.971247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:59.055222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b9316-a718-4389-95d6-d0ae2416682b None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:59.097016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fdae5-18a6-41af-80b4-1d7ff2f3a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:59.097818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fdae5-18a6-41af-80b4-1d7ff2f3a39b None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:59.098086 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fdae5-18a6-41af-80b4-1d7ff2f3a39b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:59.098384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fdae5-18a6-41af-80b4-1d7ff2f3a39b None admin] PATH_INFO: `/v3/projects/00786126b5b2412db2c4450e43bfd9cf` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:59.099558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fdae5-18a6-41af-80b4-1d7ff2f3a39b None admin] RBAC: Authorizing `identity:get_project(project_id=00786126b5b2412db2c4450e43bfd9cf)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:59.100996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fdae5-18a6-41af-80b4-1d7ff2f3a39b None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:59.102778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 571/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:05:58 2022] GET /identity/v3/projects/00786126b5b2412db2c4450e43bfd9cf => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:05:59.109288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d5954-abe4-40ac-819d-f73d3e9595d6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:05:59.151215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:05:59.231479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d5954-abe4-40ac-819d-f73d3e9595d6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:05:59.268108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd97209-e898-4ac6-bb75-eb6d8a469f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:05:59.268757 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd97209-e898-4ac6-bb75-eb6d8a469f81 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:05:59.269034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd97209-e898-4ac6-bb75-eb6d8a469f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:05:59.269300 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd97209-e898-4ac6-bb75-eb6d8a469f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:05:59.270115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd97209-e898-4ac6-bb75-eb6d8a469f81 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=00786126b5b2412db2c4450e43bfd9cf, user.id=3c8282a09d6b4dd8863ad6236ab34559) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:05:59.270452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd97209-e898-4ac6-bb75-eb6d8a469f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:05:59.271879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd97209-e898-4ac6-bb75-eb6d8a469f81 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:05:59.277428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 575/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:05:59 2022] GET /identity/v3/role_assignments?user.id=3c8282a09d6b4dd8863ad6236ab34559&scope.project.id=00786126b5b2412db2c4450e43bfd9cf&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:01.253087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60406e2-c64f-42ef-96aa-2697a2430764 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:01.253643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60406e2-c64f-42ef-96aa-2697a2430764 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:01.253643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60406e2-c64f-42ef-96aa-2697a2430764 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:01.255074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 572/1147] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:06:01.261602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410410b-943d-4f0d-9335-ed8ba5f8d9ae None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:01.262359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410410b-943d-4f0d-9335-ed8ba5f8d9ae None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:01.262488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410410b-943d-4f0d-9335-ed8ba5f8d9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:01.282852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f410410b-943d-4f0d-9335-ed8ba5f8d9ae None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:06:01.284035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f410410b-943d-4f0d-9335-ed8ba5f8d9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:06:01.358384 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 576/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:06:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:06:01.394047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60406e2-c64f-42ef-96aa-2697a2430764 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:01.489593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:01.508062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60406e2-c64f-42ef-96aa-2697a2430764 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:01.548653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609574b-d007-44fb-abee-31ffb3382c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:01.549438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609574b-d007-44fb-abee-31ffb3382c06 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:01.549713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609574b-d007-44fb-abee-31ffb3382c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:01.549981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609574b-d007-44fb-abee-31ffb3382c06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:01.563495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609574b-d007-44fb-abee-31ffb3382c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-e609574b-d007-44fb-abee-31ffb3382c06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:06:01.571035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:06:01.572114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:06:01.573327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 573/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:06:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:06:01.582785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410410b-943d-4f0d-9335-ed8ba5f8d9ae None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:01.611696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:01.707526 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410410b-943d-4f0d-9335-ed8ba5f8d9ae None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:01.745970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9c3e6-f630-4e15-a5c9-3181fb6f9f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:01.746670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9c3e6-f630-4e15-a5c9-3181fb6f9f48 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:01.746951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9c3e6-f630-4e15-a5c9-3181fb6f9f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:01.747225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9c3e6-f630-4e15-a5c9-3181fb6f9f48 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:01.747970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9c3e6-f630-4e15-a5c9-3181fb6f9f48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:06:01.748277 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9c3e6-f630-4e15-a5c9-3181fb6f9f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:01.749847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9c3e6-f630-4e15-a5c9-3181fb6f9f48 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:01.758149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 577/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:06:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:01.764782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609574b-d007-44fb-abee-31ffb3382c06 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:01.888440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609574b-d007-44fb-abee-31ffb3382c06 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:01.928559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eebfa1-4bce-4534-9568-7903441802e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:01.929796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eebfa1-4bce-4534-9568-7903441802e4 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:01.930168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eebfa1-4bce-4534-9568-7903441802e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:01.930493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eebfa1-4bce-4534-9568-7903441802e4 None admin] PATH_INFO: `/v3/users/3c8282a09d6b4dd8863ad6236ab34559` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:01.932576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eebfa1-4bce-4534-9568-7903441802e4 None admin] RBAC: Authorizing `identity:get_user(user_id=3c8282a09d6b4dd8863ad6236ab34559)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:01.935008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eebfa1-4bce-4534-9568-7903441802e4 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:01.937402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 574/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:06:01 2022] GET /identity/v3/users/3c8282a09d6b4dd8863ad6236ab34559 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:01.943458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9c3e6-f630-4e15-a5c9-3181fb6f9f48 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:02.033281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:02.051577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9c3e6-f630-4e15-a5c9-3181fb6f9f48 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:02.086332 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07c728-12d2-4b46-af40-efca5fb98716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:02.087240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07c728-12d2-4b46-af40-efca5fb98716 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:02.087523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07c728-12d2-4b46-af40-efca5fb98716 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:02.087776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07c728-12d2-4b46-af40-efca5fb98716 None admin] PATH_INFO: `/v3/projects/00786126b5b2412db2c4450e43bfd9cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:02.089058 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07c728-12d2-4b46-af40-efca5fb98716 None admin] RBAC: Authorizing `identity:get_project(project_id=00786126b5b2412db2c4450e43bfd9cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:02.090539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07c728-12d2-4b46-af40-efca5fb98716 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:02.092212 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 578/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:06:01 2022] GET /identity/v3/projects/00786126b5b2412db2c4450e43bfd9cf => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:02.098319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eebfa1-4bce-4534-9568-7903441802e4 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:02.119448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:02.203873 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eebfa1-4bce-4534-9568-7903441802e4 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:02.248506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513632a-cafc-44e5-aef4-5603ee39e7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:02.249921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513632a-cafc-44e5-aef4-5603ee39e7b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:02.250203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513632a-cafc-44e5-aef4-5603ee39e7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:02.250493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513632a-cafc-44e5-aef4-5603ee39e7b8 None admin] PATH_INFO: `/v3/projects/00786126b5b2412db2c4450e43bfd9cf/users/3c8282a09d6b4dd8863ad6236ab34559/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:02.252515 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513632a-cafc-44e5-aef4-5603ee39e7b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=00786126b5b2412db2c4450e43bfd9cf, user_id=3c8282a09d6b4dd8863ad6236ab34559, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:02.253940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513632a-cafc-44e5-aef4-5603ee39e7b8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:02.273002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 575/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:06:02 2022] PUT /identity/v3/projects/00786126b5b2412db2c4450e43bfd9cf/users/3c8282a09d6b4dd8863ad6236ab34559/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:06:04.305975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a71a-a50b-4a49-ab05-287db2213a22 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:04.306927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a71a-a50b-4a49-ab05-287db2213a22 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:04.306927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a71a-a50b-4a49-ab05-287db2213a22 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:04.308964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 579/1154] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:06:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:06:04.314521 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa89ba-17d7-4a0a-bf3f-ee29d0f698a7 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:04.314938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa89ba-17d7-4a0a-bf3f-ee29d0f698a7 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:04.315045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa89ba-17d7-4a0a-bf3f-ee29d0f698a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:04.333527 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-62aa89ba-17d7-4a0a-bf3f-ee29d0f698a7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:06:04.334726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-62aa89ba-17d7-4a0a-bf3f-ee29d0f698a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:06:04.408588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 576/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:06:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:06:04.432156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a71a-a50b-4a49-ab05-287db2213a22 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:04.542330 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a71a-a50b-4a49-ab05-287db2213a22 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:04.577484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4220ab-6762-4cc1-a191-9a0fa5de87de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:04.578205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4220ab-6762-4cc1-a191-9a0fa5de87de None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:04.578511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4220ab-6762-4cc1-a191-9a0fa5de87de None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:04.578780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4220ab-6762-4cc1-a191-9a0fa5de87de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:04.589973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4220ab-6762-4cc1-a191-9a0fa5de87de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-8c4220ab-6762-4cc1-a191-9a0fa5de87de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:06:04.597524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:06:04.598611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:06:04.599661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 580/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:06:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:06:04.604867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa89ba-17d7-4a0a-bf3f-ee29d0f698a7 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:04.615497 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:04.707732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa89ba-17d7-4a0a-bf3f-ee29d0f698a7 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:04.743720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a051f-f2d0-49e5-bb67-bd1693591972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:04.744381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a051f-f2d0-49e5-bb67-bd1693591972 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:04.744658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a051f-f2d0-49e5-bb67-bd1693591972 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:04.744928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a051f-f2d0-49e5-bb67-bd1693591972 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:04.745662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a051f-f2d0-49e5-bb67-bd1693591972 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:06:04.745965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a051f-f2d0-49e5-bb67-bd1693591972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:04.747338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a051f-f2d0-49e5-bb67-bd1693591972 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:04.755534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 577/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:06:04.765056 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4220ab-6762-4cc1-a191-9a0fa5de87de None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:04.787244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:04.887423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4220ab-6762-4cc1-a191-9a0fa5de87de None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:04.923420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b28a9-ffba-49a9-834d-60cdaf728981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:04.924302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b28a9-ffba-49a9-834d-60cdaf728981 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:04.924579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b28a9-ffba-49a9-834d-60cdaf728981 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:04.924846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b28a9-ffba-49a9-834d-60cdaf728981 None admin] PATH_INFO: `/v3/users/3c8282a09d6b4dd8863ad6236ab34559` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:04.926279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b28a9-ffba-49a9-834d-60cdaf728981 None admin] RBAC: Authorizing `identity:get_user(user_id=3c8282a09d6b4dd8863ad6236ab34559)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:04.927765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b28a9-ffba-49a9-834d-60cdaf728981 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:04.929394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 581/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:06:04 2022] GET /identity/v3/users/3c8282a09d6b4dd8863ad6236ab34559 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:04.935422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a051f-f2d0-49e5-bb67-bd1693591972 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:05.008993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:05.045151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a051f-f2d0-49e5-bb67-bd1693591972 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:05.083552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53d8c8-1932-4243-870f-ff4c4eb99f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:05.084207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d8c8-1932-4243-870f-ff4c4eb99f0f None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:05.084485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d8c8-1932-4243-870f-ff4c4eb99f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:05.084749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d8c8-1932-4243-870f-ff4c4eb99f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:05.160262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53d8c8-1932-4243-870f-ff4c4eb99f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:05.161633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53d8c8-1932-4243-870f-ff4c4eb99f0f None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:05.234240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:05.266887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 578/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:06:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:06:05.273068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b28a9-ffba-49a9-834d-60cdaf728981 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:05.364767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:05.393403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b28a9-ffba-49a9-834d-60cdaf728981 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:05.430203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997df398-5a34-43f3-94c4-4a49057db48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:05.431033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997df398-5a34-43f3-94c4-4a49057db48a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:05.431312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997df398-5a34-43f3-94c4-4a49057db48a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:05.431581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997df398-5a34-43f3-94c4-4a49057db48a None admin] PATH_INFO: `/v3/projects/00786126b5b2412db2c4450e43bfd9cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:05.432819 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997df398-5a34-43f3-94c4-4a49057db48a None admin] RBAC: Authorizing `identity:get_project(project_id=00786126b5b2412db2c4450e43bfd9cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:05.434263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997df398-5a34-43f3-94c4-4a49057db48a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:05.436000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 582/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:06:05 2022] GET /identity/v3/projects/00786126b5b2412db2c4450e43bfd9cf => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:05.445523 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53d8c8-1932-4243-870f-ff4c4eb99f0f None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:05.552685 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53d8c8-1932-4243-870f-ff4c4eb99f0f None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:05.587830 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69672c7-169a-4807-ac4d-b6b0b4007f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:05.588478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69672c7-169a-4807-ac4d-b6b0b4007f73 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:05.588755 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69672c7-169a-4807-ac4d-b6b0b4007f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:05.589027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69672c7-169a-4807-ac4d-b6b0b4007f73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:05.589853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69672c7-169a-4807-ac4d-b6b0b4007f73 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=00786126b5b2412db2c4450e43bfd9cf, user.id=3c8282a09d6b4dd8863ad6236ab34559) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:06:05.590161 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69672c7-169a-4807-ac4d-b6b0b4007f73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:05.591611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69672c7-169a-4807-ac4d-b6b0b4007f73 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:05.597724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 579/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:06:05 2022] GET /identity/v3/role_assignments?user.id=3c8282a09d6b4dd8863ad6236ab34559&scope.project.id=00786126b5b2412db2c4450e43bfd9cf&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:07.637308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076a208-7ac8-4ed1-8ce9-df9408b28d50 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:07.637876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076a208-7ac8-4ed1-8ce9-df9408b28d50 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:07.637876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076a208-7ac8-4ed1-8ce9-df9408b28d50 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:07.639277 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 583/1162] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:06:07.645843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc08b2-84eb-48bd-a09a-1752a1681071 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:07.646567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc08b2-84eb-48bd-a09a-1752a1681071 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:07.646782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc08b2-84eb-48bd-a09a-1752a1681071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:07.668129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-0bfc08b2-84eb-48bd-a09a-1752a1681071 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:06:07.669384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-0bfc08b2-84eb-48bd-a09a-1752a1681071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:06:07.706196 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:07.752287 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 580/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:06:07.774900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076a208-7ac8-4ed1-8ce9-df9408b28d50 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:07.882471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076a208-7ac8-4ed1-8ce9-df9408b28d50 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:07.916401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b6bd4-ee03-4d8c-801e-bd9fc377bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:07.916981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6bd4-ee03-4d8c-801e-bd9fc377bd2f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:07.917262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6bd4-ee03-4d8c-801e-bd9fc377bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:07.917535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6bd4-ee03-4d8c-801e-bd9fc377bd2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:07.936725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:07.987773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b6bd4-ee03-4d8c-801e-bd9fc377bd2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:07.989573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b6bd4-ee03-4d8c-801e-bd9fc377bd2f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:08.096985 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 584/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:06:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:06:08.103374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc08b2-84eb-48bd-a09a-1752a1681071 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:08.207506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc08b2-84eb-48bd-a09a-1752a1681071 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:08.246432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5db50f-66f6-4bd3-856f-e1294ebf0b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:08.247235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5db50f-66f6-4bd3-856f-e1294ebf0b06 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:08.247515 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5db50f-66f6-4bd3-856f-e1294ebf0b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:08.247781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5db50f-66f6-4bd3-856f-e1294ebf0b06 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:08.255125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5db50f-66f6-4bd3-856f-e1294ebf0b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:08.256567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5db50f-66f6-4bd3-856f-e1294ebf0b06 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-3a5db50f-66f6-4bd3-856f-e1294ebf0b06 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:06:08.270964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:06:08.272098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:06:08.273072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 581/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Jun 28 03:06:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:06:08.279055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b6bd4-ee03-4d8c-801e-bd9fc377bd2f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:08.337824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:08.394026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b6bd4-ee03-4d8c-801e-bd9fc377bd2f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:08.434708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10c230-a32d-4a52-aee1-533c12e642cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:08.435367 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10c230-a32d-4a52-aee1-533c12e642cd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:08.435645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10c230-a32d-4a52-aee1-533c12e642cd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:08.435914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10c230-a32d-4a52-aee1-533c12e642cd None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:08.436907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10c230-a32d-4a52-aee1-533c12e642cd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:06:08.437255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10c230-a32d-4a52-aee1-533c12e642cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:08.438658 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10c230-a32d-4a52-aee1-533c12e642cd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:08.445944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 585/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Jun 28 03:06:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:10.450347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1a2e-0dab-4313-9ff9-5ba56a3118dd None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:10.450909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1a2e-0dab-4313-9ff9-5ba56a3118dd None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:10.450909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1a2e-0dab-4313-9ff9-5ba56a3118dd None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:10.452487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 582/1167] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:06:10.458930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e06f3-06c7-4673-98f6-9055143b9947 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:10.459690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e06f3-06c7-4673-98f6-9055143b9947 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:10.459818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e06f3-06c7-4673-98f6-9055143b9947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:10.485513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-658e06f3-06c7-4673-98f6-9055143b9947 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:06:10.486750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-658e06f3-06c7-4673-98f6-9055143b9947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:06:10.571064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 586/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:06:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:06:10.594356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f1a2e-0dab-4313-9ff9-5ba56a3118dd None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:10.625639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:10.717150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f1a2e-0dab-4313-9ff9-5ba56a3118dd None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:10.762626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949251fd-cb1a-4883-a59b-7d02adb69f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:10.763285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949251fd-cb1a-4883-a59b-7d02adb69f0d None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:10.763559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949251fd-cb1a-4883-a59b-7d02adb69f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:10.763825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949251fd-cb1a-4883-a59b-7d02adb69f0d None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:10.764685 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949251fd-cb1a-4883-a59b-7d02adb69f0d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:10.766485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949251fd-cb1a-4883-a59b-7d02adb69f0d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:10.785018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 583/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Tue Jun 28 03:06:10 2022] POST /identity/v3/domains => generated 267 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:06:12.852553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e4cc4-2f21-4c35-a2e1-e197708764ad None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:12.853112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e4cc4-2f21-4c35-a2e1-e197708764ad None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:12.853112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e4cc4-2f21-4c35-a2e1-e197708764ad None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:12.854518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 587/1170] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:06:12.860811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a84770-3985-4603-a5ab-7e1f7d7be897 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:12.861223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a84770-3985-4603-a5ab-7e1f7d7be897 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:12.861399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a84770-3985-4603-a5ab-7e1f7d7be897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:12.884843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-89a84770-3985-4603-a5ab-7e1f7d7be897 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:06:12.886175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-89a84770-3985-4603-a5ab-7e1f7d7be897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:06:12.958029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 584/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:06:12.982065 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e4cc4-2f21-4c35-a2e1-e197708764ad None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:13.033578 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:13.105878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e4cc4-2f21-4c35-a2e1-e197708764ad None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:13.148932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe560742-b97f-4294-8a9a-adcdf1b7a935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:13.149805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe560742-b97f-4294-8a9a-adcdf1b7a935 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:13.150079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe560742-b97f-4294-8a9a-adcdf1b7a935 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:13.150357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe560742-b97f-4294-8a9a-adcdf1b7a935 None admin] PATH_INFO: `/v3/domains/b29962f4e61e45069021da3626b22cfb` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:13.161284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe560742-b97f-4294-8a9a-adcdf1b7a935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b29962f4e61e45069021da3626b22cfb)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:13.162766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe560742-b97f-4294-8a9a-adcdf1b7a935 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:13.164399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 588/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Tue Jun 28 03:06:12 2022] GET /identity/v3/domains/b29962f4e61e45069021da3626b22cfb => generated 267 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:13.170628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a84770-3985-4603-a5ab-7e1f7d7be897 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:13.186597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:13.276277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a84770-3985-4603-a5ab-7e1f7d7be897 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:13.311101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3013be2-c5df-4eb6-883a-4f2db54402e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:13.311779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3013be2-c5df-4eb6-883a-4f2db54402e4 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:13.312048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3013be2-c5df-4eb6-883a-4f2db54402e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:13.312316 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3013be2-c5df-4eb6-883a-4f2db54402e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:13.313017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3013be2-c5df-4eb6-883a-4f2db54402e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:13.314472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3013be2-c5df-4eb6-883a-4f2db54402e4 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:13.343681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 585/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:06:13 2022] POST /identity/v3/projects => generated 361 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:06:15.370066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51a8d-4795-44de-8653-78bc2ef3cdbd None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:15.370668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51a8d-4795-44de-8653-78bc2ef3cdbd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:15.370668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51a8d-4795-44de-8653-78bc2ef3cdbd None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:15.372003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 589/1174] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:06:15.378449 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2461-58f6-4188-9b74-8c792cfcc1e0 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:15.379174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2461-58f6-4188-9b74-8c792cfcc1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:15.379365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2461-58f6-4188-9b74-8c792cfcc1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:15.407634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-623f2461-58f6-4188-9b74-8c792cfcc1e0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:06:15.408814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-623f2461-58f6-4188-9b74-8c792cfcc1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:06:15.471321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:15.484820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 586/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:06:15.510318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df51a8d-4795-44de-8653-78bc2ef3cdbd None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:15.631309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df51a8d-4795-44de-8653-78bc2ef3cdbd None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:15.632817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:15.666874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0235696-6c72-4c73-91f7-84d568907230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:15.667736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0235696-6c72-4c73-91f7-84d568907230 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:15.668014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0235696-6c72-4c73-91f7-84d568907230 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:15.668286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0235696-6c72-4c73-91f7-84d568907230 None admin] PATH_INFO: `/v3/domains/b29962f4e61e45069021da3626b22cfb` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:15.669514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0235696-6c72-4c73-91f7-84d568907230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b29962f4e61e45069021da3626b22cfb)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:15.671036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0235696-6c72-4c73-91f7-84d568907230 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:15.672646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 590/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Tue Jun 28 03:06:15 2022] GET /identity/v3/domains/b29962f4e61e45069021da3626b22cfb => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:15.678891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f2461-58f6-4188-9b74-8c792cfcc1e0 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:15.783369 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f2461-58f6-4188-9b74-8c792cfcc1e0 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:15.819613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64572bc4-c401-4b50-bc7e-d4325d937d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:15.820299 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572bc4-c401-4b50-bc7e-d4325d937d32 None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:15.820587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572bc4-c401-4b50-bc7e-d4325d937d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:15.820862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572bc4-c401-4b50-bc7e-d4325d937d32 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:15.821575 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64572bc4-c401-4b50-bc7e-d4325d937d32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:15.823051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64572bc4-c401-4b50-bc7e-d4325d937d32 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:15.845947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 587/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:06:15 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:06:17.917697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927fc1-1140-4532-bcb6-fab5454e89c7 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:17.918270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927fc1-1140-4532-bcb6-fab5454e89c7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:17.918270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927fc1-1140-4532-bcb6-fab5454e89c7 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:17.919623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 591/1178] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:06:17.926478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a1f3-864f-4f3d-bb03-8a8daba8cf54 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:17.926931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a1f3-864f-4f3d-bb03-8a8daba8cf54 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:17.927025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a1f3-864f-4f3d-bb03-8a8daba8cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:17.953133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-1bf4a1f3-864f-4f3d-bb03-8a8daba8cf54 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:06:17.954323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1bf4a1f3-864f-4f3d-bb03-8a8daba8cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:06:18.008517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:18.031670 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 588/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:06:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:06:18.055410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927fc1-1140-4532-bcb6-fab5454e89c7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:18.172937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927fc1-1140-4532-bcb6-fab5454e89c7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:18.209700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594967ab-64e3-47e1-b705-2b8320f97761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:18.210525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594967ab-64e3-47e1-b705-2b8320f97761 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:18.210800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594967ab-64e3-47e1-b705-2b8320f97761 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:18.211062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594967ab-64e3-47e1-b705-2b8320f97761 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:18.222408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594967ab-64e3-47e1-b705-2b8320f97761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-594967ab-64e3-47e1-b705-2b8320f97761 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:06:18.229948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:06:18.231153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:06:18.232079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 592/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:06:18.239446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a1f3-864f-4f3d-bb03-8a8daba8cf54 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:18.344422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a1f3-864f-4f3d-bb03-8a8daba8cf54 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:18.380490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256685f-d540-491b-848e-bce670ed68da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:18.381158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256685f-d540-491b-848e-bce670ed68da None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:18.381443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256685f-d540-491b-848e-bce670ed68da None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:18.381706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256685f-d540-491b-848e-bce670ed68da None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:18.382486 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256685f-d540-491b-848e-bce670ed68da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:06:18.382791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256685f-d540-491b-848e-bce670ed68da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:18.384163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256685f-d540-491b-848e-bce670ed68da None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:18.392482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 589/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:06:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:18.399179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594967ab-64e3-47e1-b705-2b8320f97761 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:18.435923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:18.509545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594967ab-64e3-47e1-b705-2b8320f97761 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:18.544106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce156144-627f-4e90-a1a6-3cc494b2f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:18.544983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce156144-627f-4e90-a1a6-3cc494b2f70f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:18.545258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce156144-627f-4e90-a1a6-3cc494b2f70f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:18.545647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce156144-627f-4e90-a1a6-3cc494b2f70f None admin] PATH_INFO: `/v3/users/d78439a6bb8649c2b87d9b668814c38b` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:18.559217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce156144-627f-4e90-a1a6-3cc494b2f70f None admin] RBAC: Authorizing `identity:get_user(user_id=d78439a6bb8649c2b87d9b668814c38b)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:18.560652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce156144-627f-4e90-a1a6-3cc494b2f70f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:18.562561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 593/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:06:18 2022] GET /identity/v3/users/d78439a6bb8649c2b87d9b668814c38b => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:18.571865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256685f-d540-491b-848e-bce670ed68da None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:18.626760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:18.683251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256685f-d540-491b-848e-bce670ed68da None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:18.721567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c203d-8d47-4387-b7c2-6f36f53f5c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:18.722156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c203d-8d47-4387-b7c2-6f36f53f5c4d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:18.722465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c203d-8d47-4387-b7c2-6f36f53f5c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:18.722741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c203d-8d47-4387-b7c2-6f36f53f5c4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:18.792226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c203d-8d47-4387-b7c2-6f36f53f5c4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:18.793658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c203d-8d47-4387-b7c2-6f36f53f5c4d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:18.844752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:18.905573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 590/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:06:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:06:18.911641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce156144-627f-4e90-a1a6-3cc494b2f70f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:19.005717 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:19.026086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce156144-627f-4e90-a1a6-3cc494b2f70f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:19.063768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc345f-8dcd-4a56-97c8-ac46b06612e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:19.064666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc345f-8dcd-4a56-97c8-ac46b06612e0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:19.064942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc345f-8dcd-4a56-97c8-ac46b06612e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:19.065210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc345f-8dcd-4a56-97c8-ac46b06612e0 None admin] PATH_INFO: `/v3/projects/2f6a25de99bd4181b294a795855e4254` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:19.066421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc345f-8dcd-4a56-97c8-ac46b06612e0 None admin] RBAC: Authorizing `identity:get_project(project_id=2f6a25de99bd4181b294a795855e4254)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:19.067838 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc345f-8dcd-4a56-97c8-ac46b06612e0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:19.069574 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 594/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:06:18 2022] GET /identity/v3/projects/2f6a25de99bd4181b294a795855e4254 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:19.075777 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c203d-8d47-4387-b7c2-6f36f53f5c4d None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:19.184513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c203d-8d47-4387-b7c2-6f36f53f5c4d None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:19.222004 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bedf1e-af00-4450-b2d4-5172d51d3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:19.222710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bedf1e-af00-4450-b2d4-5172d51d3e92 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:19.222997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bedf1e-af00-4450-b2d4-5172d51d3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:19.223273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bedf1e-af00-4450-b2d4-5172d51d3e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:19.224111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bedf1e-af00-4450-b2d4-5172d51d3e92 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=2f6a25de99bd4181b294a795855e4254, user.id=d78439a6bb8649c2b87d9b668814c38b) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:06:19.224451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bedf1e-af00-4450-b2d4-5172d51d3e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:19.225894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bedf1e-af00-4450-b2d4-5172d51d3e92 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:19.231952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 591/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:06:19 2022] GET /identity/v3/role_assignments?user.id=d78439a6bb8649c2b87d9b668814c38b&scope.project.id=2f6a25de99bd4181b294a795855e4254&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:21.223216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6599-6d65-4cfc-8859-0eced053e55c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:21.223803 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6599-6d65-4cfc-8859-0eced053e55c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:21.223803 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa6599-6d65-4cfc-8859-0eced053e55c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:21.225122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 595/1186] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:06:21.232223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac10cd-66cd-417d-99b5-4174ce19cc8e None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:21.233197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac10cd-66cd-417d-99b5-4174ce19cc8e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:21.233808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac10cd-66cd-417d-99b5-4174ce19cc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:21.260035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-46ac10cd-66cd-417d-99b5-4174ce19cc8e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:06:21.261218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-46ac10cd-66cd-417d-99b5-4174ce19cc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:06:21.263202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:21.338052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 592/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:06:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:06:21.372383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa6599-6d65-4cfc-8859-0eced053e55c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:21.483975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa6599-6d65-4cfc-8859-0eced053e55c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:21.519262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac76937-187c-4514-a5d5-af205490243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:21.520059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac76937-187c-4514-a5d5-af205490243b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:21.520338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac76937-187c-4514-a5d5-af205490243b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:21.520605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac76937-187c-4514-a5d5-af205490243b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:21.530842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac76937-187c-4514-a5d5-af205490243b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-1ac76937-187c-4514-a5d5-af205490243b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:06:21.539833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:06:21.540847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:06:21.541774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 596/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:06:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:06:21.547953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac10cd-66cd-417d-99b5-4174ce19cc8e None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:21.655945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac10cd-66cd-417d-99b5-4174ce19cc8e None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:21.698715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fa7e5-281d-49fe-946e-e5c06f8d9062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:21.699408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa7e5-281d-49fe-946e-e5c06f8d9062 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:21.699689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa7e5-281d-49fe-946e-e5c06f8d9062 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:21.699955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa7e5-281d-49fe-946e-e5c06f8d9062 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:21.700705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fa7e5-281d-49fe-946e-e5c06f8d9062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:06:21.701008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fa7e5-281d-49fe-946e-e5c06f8d9062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:21.702741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fa7e5-281d-49fe-946e-e5c06f8d9062 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:21.708329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:21.712462 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 593/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:06:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:21.718719 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac76937-187c-4514-a5d5-af205490243b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:21.739725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:21.824182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac76937-187c-4514-a5d5-af205490243b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:21.859193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566f81a-fa91-4331-a55c-593026df7460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:21.860073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f81a-fa91-4331-a55c-593026df7460 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:21.860347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f81a-fa91-4331-a55c-593026df7460 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:21.860610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f81a-fa91-4331-a55c-593026df7460 None admin] PATH_INFO: `/v3/users/d78439a6bb8649c2b87d9b668814c38b` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:21.861884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566f81a-fa91-4331-a55c-593026df7460 None admin] RBAC: Authorizing `identity:get_user(user_id=d78439a6bb8649c2b87d9b668814c38b)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:21.863711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566f81a-fa91-4331-a55c-593026df7460 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:21.865325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 597/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:06:21 2022] GET /identity/v3/users/d78439a6bb8649c2b87d9b668814c38b => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:21.871765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fa7e5-281d-49fe-946e-e5c06f8d9062 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:21.979292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fa7e5-281d-49fe-946e-e5c06f8d9062 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:22.016159 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fbd0d-ab4c-48b0-ac2e-ea09619e8e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:22.017032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fbd0d-ab4c-48b0-ac2e-ea09619e8e18 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:22.017309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fbd0d-ab4c-48b0-ac2e-ea09619e8e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:22.017576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fbd0d-ab4c-48b0-ac2e-ea09619e8e18 None admin] PATH_INFO: `/v3/projects/2f6a25de99bd4181b294a795855e4254` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:22.018900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fbd0d-ab4c-48b0-ac2e-ea09619e8e18 None admin] RBAC: Authorizing `identity:get_project(project_id=2f6a25de99bd4181b294a795855e4254)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:22.020340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fbd0d-ab4c-48b0-ac2e-ea09619e8e18 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:22.022084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 594/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:06:21 2022] GET /identity/v3/projects/2f6a25de99bd4181b294a795855e4254 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:22.028413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566f81a-fa91-4331-a55c-593026df7460 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:22.122688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:22.139965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566f81a-fa91-4331-a55c-593026df7460 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:22.174495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4638ed-9b55-4173-b13d-603ac7695445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:22.175391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4638ed-9b55-4173-b13d-603ac7695445 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:22.175666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4638ed-9b55-4173-b13d-603ac7695445 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:22.175935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4638ed-9b55-4173-b13d-603ac7695445 None admin] PATH_INFO: `/v3/projects/2f6a25de99bd4181b294a795855e4254/users/d78439a6bb8649c2b87d9b668814c38b/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:22.178003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4638ed-9b55-4173-b13d-603ac7695445 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f6a25de99bd4181b294a795855e4254, user_id=d78439a6bb8649c2b87d9b668814c38b, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:22.179481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4638ed-9b55-4173-b13d-603ac7695445 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:22.195477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 598/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:06:22 2022] PUT /identity/v3/projects/2f6a25de99bd4181b294a795855e4254/users/d78439a6bb8649c2b87d9b668814c38b/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:06:24.206887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75889e-3cad-49e4-b021-06d7084886c4 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:24.207469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75889e-3cad-49e4-b021-06d7084886c4 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:24.207469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75889e-3cad-49e4-b021-06d7084886c4 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:24.208847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 595/1193] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:06:24.215242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff5c0-1dcc-423f-9e78-0a6552292b31 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:24.215970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff5c0-1dcc-423f-9e78-0a6552292b31 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:24.216142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff5c0-1dcc-423f-9e78-0a6552292b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:24.236696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-80aff5c0-1dcc-423f-9e78-0a6552292b31 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:06:24.238250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-80aff5c0-1dcc-423f-9e78-0a6552292b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:06:24.308815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 599/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:06:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:06:24.333099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75889e-3cad-49e4-b021-06d7084886c4 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:24.412416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:24.458693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75889e-3cad-49e4-b021-06d7084886c4 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:24.500072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476c473-3980-4fc7-b549-0c9e8a76b8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:24.500877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c473-3980-4fc7-b549-0c9e8a76b8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:24.501154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c473-3980-4fc7-b549-0c9e8a76b8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:24.501418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c473-3980-4fc7-b549-0c9e8a76b8c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:24.511936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476c473-3980-4fc7-b549-0c9e8a76b8c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-b476c473-3980-4fc7-b549-0c9e8a76b8c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:06:24.519708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:06:24.520816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:06:24.522053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 596/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:06:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:06:24.527268 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aff5c0-1dcc-423f-9e78-0a6552292b31 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:24.603433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:24.630915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aff5c0-1dcc-423f-9e78-0a6552292b31 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:24.665297 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7679-c324-46a4-92bf-371edf557aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:24.665962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7679-c324-46a4-92bf-371edf557aab None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:24.666233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7679-c324-46a4-92bf-371edf557aab None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:24.666531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd7679-c324-46a4-92bf-371edf557aab None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:24.667265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd7679-c324-46a4-92bf-371edf557aab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:06:24.667571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd7679-c324-46a4-92bf-371edf557aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:24.668931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd7679-c324-46a4-92bf-371edf557aab None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:24.676965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 600/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:06:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:06:24.685655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476c473-3980-4fc7-b549-0c9e8a76b8c1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:24.792684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476c473-3980-4fc7-b549-0c9e8a76b8c1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:24.821553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:24.831273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b2527-e5c6-4d62-ada1-cb053baa06e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:24.832180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b2527-e5c6-4d62-ada1-cb053baa06e8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:24.832461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b2527-e5c6-4d62-ada1-cb053baa06e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:24.832731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b2527-e5c6-4d62-ada1-cb053baa06e8 None admin] PATH_INFO: `/v3/users/d78439a6bb8649c2b87d9b668814c38b` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:24.833984 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b2527-e5c6-4d62-ada1-cb053baa06e8 None admin] RBAC: Authorizing `identity:get_user(user_id=d78439a6bb8649c2b87d9b668814c38b)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:24.835466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b2527-e5c6-4d62-ada1-cb053baa06e8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:24.837113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 597/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Jun 28 03:06:24 2022] GET /identity/v3/users/d78439a6bb8649c2b87d9b668814c38b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:06:24.843921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7679-c324-46a4-92bf-371edf557aab None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:24.965051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd7679-c324-46a4-92bf-371edf557aab None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:25.002669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4461f54-d00a-4523-bfe5-59bcee22fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:25.003318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4461f54-d00a-4523-bfe5-59bcee22fdbf None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:25.003599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4461f54-d00a-4523-bfe5-59bcee22fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:25.003872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4461f54-d00a-4523-bfe5-59bcee22fdbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:25.007408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:25.074015 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4461f54-d00a-4523-bfe5-59bcee22fdbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:25.075552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4461f54-d00a-4523-bfe5-59bcee22fdbf None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:25.183218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 601/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:06:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:06:25.190422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b2527-e5c6-4d62-ada1-cb053baa06e8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:25.305019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b2527-e5c6-4d62-ada1-cb053baa06e8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:25.340448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37ecf7-e0a2-41ac-8b2d-48383a5faf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:25.341302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ecf7-e0a2-41ac-8b2d-48383a5faf94 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:25.341574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ecf7-e0a2-41ac-8b2d-48383a5faf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:25.341841 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ecf7-e0a2-41ac-8b2d-48383a5faf94 None admin] PATH_INFO: `/v3/projects/2f6a25de99bd4181b294a795855e4254` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:25.343493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37ecf7-e0a2-41ac-8b2d-48383a5faf94 None admin] RBAC: Authorizing `identity:get_project(project_id=2f6a25de99bd4181b294a795855e4254)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:25.344917 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37ecf7-e0a2-41ac-8b2d-48383a5faf94 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:25.346641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 598/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Jun 28 03:06:25 2022] GET /identity/v3/projects/2f6a25de99bd4181b294a795855e4254 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:25.356210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4461f54-d00a-4523-bfe5-59bcee22fdbf None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:06:25.396203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:25.464016 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4461f54-d00a-4523-bfe5-59bcee22fdbf None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:06:25.501957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370faeaf-1891-44b5-85ba-4e1b97d9607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:06:25.502647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370faeaf-1891-44b5-85ba-4e1b97d9607e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:06:25.503061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370faeaf-1891-44b5-85ba-4e1b97d9607e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:06:25.503472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370faeaf-1891-44b5-85ba-4e1b97d9607e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:06:25.504448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370faeaf-1891-44b5-85ba-4e1b97d9607e None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=2f6a25de99bd4181b294a795855e4254, user.id=d78439a6bb8649c2b87d9b668814c38b) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:06:25.504764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370faeaf-1891-44b5-85ba-4e1b97d9607e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:06:25.506203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370faeaf-1891-44b5-85ba-4e1b97d9607e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:06:25.512236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 602/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:06:25 2022] GET /identity/v3/role_assignments?user.id=d78439a6bb8649c2b87d9b668814c38b&scope.project.id=2f6a25de99bd4181b294a795855e4254&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:06:35.335505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=68 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:06:35.509525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=50 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:21.148832 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aedefd-fd4b-4e9f-bb6b-8f945e52f304 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:21.149427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aedefd-fd4b-4e9f-bb6b-8f945e52f304 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:21.149427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aedefd-fd4b-4e9f-bb6b-8f945e52f304 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:21.150835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 599/1201] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:07:21.156478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9874d1-b707-4400-b88a-a4df02dd6a2a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:21.157288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9874d1-b707-4400-b88a-a4df02dd6a2a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:21.157564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9874d1-b707-4400-b88a-a4df02dd6a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:21.175918 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fa9874d1-b707-4400-b88a-a4df02dd6a2a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:07:21.177063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fa9874d1-b707-4400-b88a-a4df02dd6a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:07:21.260487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 603/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:07:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 03:07:21.285069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aedefd-fd4b-4e9f-bb6b-8f945e52f304 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:21.417491 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aedefd-fd4b-4e9f-bb6b-8f945e52f304 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:21.459129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d98bd-9daf-413c-8cd5-e9b585959c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:21.459989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d98bd-9daf-413c-8cd5-e9b585959c69 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:21.460246 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d98bd-9daf-413c-8cd5-e9b585959c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:21.460518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d98bd-9daf-413c-8cd5-e9b585959c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:21.472199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d98bd-9daf-413c-8cd5-e9b585959c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:21.473658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d98bd-9daf-413c-8cd5-e9b585959c69 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-841d98bd-9daf-413c-8cd5-e9b585959c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:21.493481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:21.494680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:21.495682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:21.495682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:21.495682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:21.495682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:21.500588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 600/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:21.501645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9874d1-b707-4400-b88a-a4df02dd6a2a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:21.627618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9874d1-b707-4400-b88a-a4df02dd6a2a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:21.669332 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:21.679669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ab4ec-7799-4471-a126-7459f551c158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:21.680450 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab4ec-7799-4471-a126-7459f551c158 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:21.680787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab4ec-7799-4471-a126-7459f551c158 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:21.681112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab4ec-7799-4471-a126-7459f551c158 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:21.682025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ab4ec-7799-4471-a126-7459f551c158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:21.682393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ab4ec-7799-4471-a126-7459f551c158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:21.683929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ab4ec-7799-4471-a126-7459f551c158 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:21.700365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 604/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:21.707172 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d98bd-9daf-413c-8cd5-e9b585959c69 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:21.769413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:21.850381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d98bd-9daf-413c-8cd5-e9b585959c69 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:21.904046 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dc7af-6e8a-4c31-bd14-bffb15fc25bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:21.904746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc7af-6e8a-4c31-bd14-bffb15fc25bc None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:21.905027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc7af-6e8a-4c31-bd14-bffb15fc25bc None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:21.905306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc7af-6e8a-4c31-bd14-bffb15fc25bc None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:21.906182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dc7af-6e8a-4c31-bd14-bffb15fc25bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:21.907749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dc7af-6e8a-4c31-bd14-bffb15fc25bc None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:21.954630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 601/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Jun 28 03:07:21 2022] POST /identity/v3/users => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:07:24.135075 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f5936-7ac9-4fec-8ba2-e6fe214f1f34 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:24.135650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f5936-7ac9-4fec-8ba2-e6fe214f1f34 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:24.135650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f5936-7ac9-4fec-8ba2-e6fe214f1f34 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:24.137087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 605/1206] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:07:24.143366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a13f9-585c-4049-8f11-39ab4c773bf6 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:24.143799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a13f9-585c-4049-8f11-39ab4c773bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:24.144046 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a13f9-585c-4049-8f11-39ab4c773bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:24.163237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-965a13f9-585c-4049-8f11-39ab4c773bf6 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:07:24.164570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-965a13f9-585c-4049-8f11-39ab4c773bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:07:24.249051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 602/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:07:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:07:24.277922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f5936-7ac9-4fec-8ba2-e6fe214f1f34 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:24.415243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f5936-7ac9-4fec-8ba2-e6fe214f1f34 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:24.459736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a809-e0f3-4de9-b297-476dd0df33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:24.460581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a809-e0f3-4de9-b297-476dd0df33a4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:24.460865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a809-e0f3-4de9-b297-476dd0df33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:24.461142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a809-e0f3-4de9-b297-476dd0df33a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:24.473219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1a809-e0f3-4de9-b297-476dd0df33a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-5dd1a809-e0f3-4de9-b297-476dd0df33a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:07:24.481336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:24.486671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:24.489134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 606/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:07:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:24.494347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a13f9-585c-4049-8f11-39ab4c773bf6 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:24.536465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:24.607940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a13f9-585c-4049-8f11-39ab4c773bf6 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:24.647258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7ff46-b482-4f6a-85f8-9373226828d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:24.647955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7ff46-b482-4f6a-85f8-9373226828d0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:24.648237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7ff46-b482-4f6a-85f8-9373226828d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:24.648509 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7ff46-b482-4f6a-85f8-9373226828d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:24.649397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7ff46-b482-4f6a-85f8-9373226828d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:24.649711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7ff46-b482-4f6a-85f8-9373226828d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:24.651130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7ff46-b482-4f6a-85f8-9373226828d0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:24.661360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 603/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:07:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:24.668002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a809-e0f3-4de9-b297-476dd0df33a4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:24.732080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:24.791152 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a809-e0f3-4de9-b297-476dd0df33a4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:24.830030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254456b-29f5-4e58-a424-2f0929411214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:24.831140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254456b-29f5-4e58-a424-2f0929411214 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:24.831587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254456b-29f5-4e58-a424-2f0929411214 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:24.831982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254456b-29f5-4e58-a424-2f0929411214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:24.845815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254456b-29f5-4e58-a424-2f0929411214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:24.847512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254456b-29f5-4e58-a424-2f0929411214 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-5254456b-29f5-4e58-a424-2f0929411214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:24.867172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:24.868431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:24.869687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:24.869687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:24.869687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:24.869687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:24.870408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 607/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:24.878009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7ff46-b482-4f6a-85f8-9373226828d0 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:24.997041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:25.000913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7ff46-b482-4f6a-85f8-9373226828d0 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:25.041691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbca07a-f750-4885-a3d7-2d0853336670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:25.042452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbca07a-f750-4885-a3d7-2d0853336670 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:25.045332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbca07a-f750-4885-a3d7-2d0853336670 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:25.045332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbca07a-f750-4885-a3d7-2d0853336670 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:25.045332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbca07a-f750-4885-a3d7-2d0853336670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:25.045332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbca07a-f750-4885-a3d7-2d0853336670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:25.045691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbca07a-f750-4885-a3d7-2d0853336670 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:25.069731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 604/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:25.072470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254456b-29f5-4e58-a424-2f0929411214 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:25.196491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254456b-29f5-4e58-a424-2f0929411214 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:25.198549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:25.240975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4eb24-3e9d-4d0a-9e39-c965f78948b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:25.243078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4eb24-3e9d-4d0a-9e39-c965f78948b0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:25.243078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4eb24-3e9d-4d0a-9e39-c965f78948b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:25.243078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4eb24-3e9d-4d0a-9e39-c965f78948b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:25.252205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4eb24-3e9d-4d0a-9e39-c965f78948b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:25.253759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4eb24-3e9d-4d0a-9e39-c965f78948b0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-2fd4eb24-3e9d-4d0a-9e39-c965f78948b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:07:25.270934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:25.272166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:25.273363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:25.273363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:25.273363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:07:25.273363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:07:25.273363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:07:25.273363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:07:25.273363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:07:25.273363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:07:25.273363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:25.273363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:25.274462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 608/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:25.279032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbca07a-f750-4885-a3d7-2d0853336670 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:25.396557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbca07a-f750-4885-a3d7-2d0853336670 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:25.439825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d044-74b1-49d6-9b8c-5ae610dd6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:25.440723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d044-74b1-49d6-9b8c-5ae610dd6b1a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:25.441128 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d044-74b1-49d6-9b8c-5ae610dd6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:25.441517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d044-74b1-49d6-9b8c-5ae610dd6b1a None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:25.442591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8d044-74b1-49d6-9b8c-5ae610dd6b1a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:25.443024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8d044-74b1-49d6-9b8c-5ae610dd6b1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:25.444702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8d044-74b1-49d6-9b8c-5ae610dd6b1a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:25.466025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 605/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Jun 28 03:07:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:25.473069 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4eb24-3e9d-4d0a-9e39-c965f78948b0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:25.597904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4eb24-3e9d-4d0a-9e39-c965f78948b0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:25.638901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b52ec-b459-4e35-af1b-1a64c729efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:25.639688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b52ec-b459-4e35-af1b-1a64c729efbc None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:25.640211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b52ec-b459-4e35-af1b-1a64c729efbc None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:25.640621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b52ec-b459-4e35-af1b-1a64c729efbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:25.676974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:25.727102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b52ec-b459-4e35-af1b-1a64c729efbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:25.728709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b52ec-b459-4e35-af1b-1a64c729efbc None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:25.850851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 609/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:07:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:07:25.856946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d044-74b1-49d6-9b8c-5ae610dd6b1a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:25.879617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:25.972117 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d044-74b1-49d6-9b8c-5ae610dd6b1a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:26.012124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ad02f-d69f-40cd-9dfa-9bdaa573a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:26.012938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ad02f-d69f-40cd-9dfa-9bdaa573a72b None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:26.013215 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ad02f-d69f-40cd-9dfa-9bdaa573a72b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:26.013486 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ad02f-d69f-40cd-9dfa-9bdaa573a72b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:26.025583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ad02f-d69f-40cd-9dfa-9bdaa573a72b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:26.027068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ad02f-d69f-40cd-9dfa-9bdaa573a72b None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-481ad02f-d69f-40cd-9dfa-9bdaa573a72b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:26.047129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:26.048701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:26.049611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:26.049611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:26.049611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:26.049611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:26.049611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 606/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:07:26.053033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b52ec-b459-4e35-af1b-1a64c729efbc None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:26.133593 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:26.176641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b52ec-b459-4e35-af1b-1a64c729efbc None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:26.215791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960d252-7614-40a8-b99e-ad4b31bfb718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:26.218104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960d252-7614-40a8-b99e-ad4b31bfb718 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:26.218104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960d252-7614-40a8-b99e-ad4b31bfb718 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:26.218104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960d252-7614-40a8-b99e-ad4b31bfb718 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:26.218549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960d252-7614-40a8-b99e-ad4b31bfb718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:26.219118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960d252-7614-40a8-b99e-ad4b31bfb718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:26.220872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960d252-7614-40a8-b99e-ad4b31bfb718 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:26.234506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 610/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:26.240623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ad02f-d69f-40cd-9dfa-9bdaa573a72b None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:26.319233 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:26.356871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ad02f-d69f-40cd-9dfa-9bdaa573a72b None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:26.399091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be553e42-a2fd-4b03-bc90-947663ae6bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:26.399826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be553e42-a2fd-4b03-bc90-947663ae6bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:26.400106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be553e42-a2fd-4b03-bc90-947663ae6bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:26.400377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be553e42-a2fd-4b03-bc90-947663ae6bc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:26.409640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be553e42-a2fd-4b03-bc90-947663ae6bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:26.411261 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be553e42-a2fd-4b03-bc90-947663ae6bc1 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-be553e42-a2fd-4b03-bc90-947663ae6bc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:07:26.427092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:26.428844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:26.429884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:07:26.429884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:07:26.429884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:07:26.429884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:07:26.429884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:07:26.429884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:07:26.429884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:26.429884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:26.429884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 607/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:07:26.434437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960d252-7614-40a8-b99e-ad4b31bfb718 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:26.560556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960d252-7614-40a8-b99e-ad4b31bfb718 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:26.589104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:26.604213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44079b-8f98-4bb7-95f4-97edde41cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:26.604900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44079b-8f98-4bb7-95f4-97edde41cb31 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:26.605217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44079b-8f98-4bb7-95f4-97edde41cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:26.605480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44079b-8f98-4bb7-95f4-97edde41cb31 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:26.606360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44079b-8f98-4bb7-95f4-97edde41cb31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:26.606609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44079b-8f98-4bb7-95f4-97edde41cb31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:26.608762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44079b-8f98-4bb7-95f4-97edde41cb31 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:26.623220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 611/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:07:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:26.630043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be553e42-a2fd-4b03-bc90-947663ae6bc1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:26.746968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be553e42-a2fd-4b03-bc90-947663ae6bc1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:26.778561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:26.786837 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e490a7-98a6-41c4-b1eb-9cc96d1c650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:26.787513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e490a7-98a6-41c4-b1eb-9cc96d1c650a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:26.787793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e490a7-98a6-41c4-b1eb-9cc96d1c650a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:26.788065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e490a7-98a6-41c4-b1eb-9cc96d1c650a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:26.788907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e490a7-98a6-41c4-b1eb-9cc96d1c650a None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=28b8048235c6421eae12ca99f80ed5ac) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:26.789217 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e490a7-98a6-41c4-b1eb-9cc96d1c650a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:26.790683 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e490a7-98a6-41c4-b1eb-9cc96d1c650a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:26.802572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 608/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:07:26 2022] GET /identity/v3/role_assignments?user.id=28b8048235c6421eae12ca99f80ed5ac&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:28.850197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b513f1b-8417-4f54-bcc5-21afb93ddbf7 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:28.850879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b513f1b-8417-4f54-bcc5-21afb93ddbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:28.850879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b513f1b-8417-4f54-bcc5-21afb93ddbf7 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:28.852220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 612/1220] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:07:28.860661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76172f71-33ad-4a4a-8dff-95ee7fb13126 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:28.860661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76172f71-33ad-4a4a-8dff-95ee7fb13126 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:28.860661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76172f71-33ad-4a4a-8dff-95ee7fb13126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:28.877513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-76172f71-33ad-4a4a-8dff-95ee7fb13126 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:07:28.878841 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-76172f71-33ad-4a4a-8dff-95ee7fb13126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:07:28.957636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 609/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:07:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:07:28.983037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b513f1b-8417-4f54-bcc5-21afb93ddbf7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:29.098172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b513f1b-8417-4f54-bcc5-21afb93ddbf7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:29.137194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c39f7-2077-40c5-ae6e-d8329e2229ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:29.138122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c39f7-2077-40c5-ae6e-d8329e2229ed None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:29.138566 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c39f7-2077-40c5-ae6e-d8329e2229ed None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:29.138912 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c39f7-2077-40c5-ae6e-d8329e2229ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:29.149824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c39f7-2077-40c5-ae6e-d8329e2229ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d81c39f7-2077-40c5-ae6e-d8329e2229ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:07:29.157922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:29.159401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:29.160634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 613/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:07:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:29.165457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76172f71-33ad-4a4a-8dff-95ee7fb13126 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:29.275470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76172f71-33ad-4a4a-8dff-95ee7fb13126 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:29.302171 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:29.315123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9a049-58ef-4289-b45b-52d0fcacfcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:29.315846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9a049-58ef-4289-b45b-52d0fcacfcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:29.316178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9a049-58ef-4289-b45b-52d0fcacfcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:29.316490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9a049-58ef-4289-b45b-52d0fcacfcd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:29.317370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9a049-58ef-4289-b45b-52d0fcacfcd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:29.317712 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9a049-58ef-4289-b45b-52d0fcacfcd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:29.319433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9a049-58ef-4289-b45b-52d0fcacfcd8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:29.328774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 610/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:07:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:29.334733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c39f7-2077-40c5-ae6e-d8329e2229ed None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:29.381653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:29.445818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c39f7-2077-40c5-ae6e-d8329e2229ed None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:29.485150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8253628-c343-4202-b852-ea5188041cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:29.486347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253628-c343-4202-b852-ea5188041cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:29.486636 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253628-c343-4202-b852-ea5188041cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:29.486903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253628-c343-4202-b852-ea5188041cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:29.500143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8253628-c343-4202-b852-ea5188041cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:29.501889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8253628-c343-4202-b852-ea5188041cd1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a8253628-c343-4202-b852-ea5188041cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:29.521361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:29.522629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:29.523908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:29.523908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:29.523908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:29.523908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:29.523908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 614/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:29.529059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9a049-58ef-4289-b45b-52d0fcacfcd8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:29.635250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9a049-58ef-4289-b45b-52d0fcacfcd8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:29.671226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853f715-69eb-459a-8e2a-a9657e9f7410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:29.671970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853f715-69eb-459a-8e2a-a9657e9f7410 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:29.672273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853f715-69eb-459a-8e2a-a9657e9f7410 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:29.672548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853f715-69eb-459a-8e2a-a9657e9f7410 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:29.673312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853f715-69eb-459a-8e2a-a9657e9f7410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:29.673621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853f715-69eb-459a-8e2a-a9657e9f7410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:29.675076 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853f715-69eb-459a-8e2a-a9657e9f7410 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:29.688464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 611/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:29.694525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8253628-c343-4202-b852-ea5188041cd1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:29.804569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:29.812023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8253628-c343-4202-b852-ea5188041cd1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:29.848114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1a337-def3-425c-8318-424e18382f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:29.849025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1a337-def3-425c-8318-424e18382f94 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:29.849306 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1a337-def3-425c-8318-424e18382f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:29.849615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1a337-def3-425c-8318-424e18382f94 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:29.858043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1a337-def3-425c-8318-424e18382f94 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:29.859979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1a337-def3-425c-8318-424e18382f94 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-76c1a337-def3-425c-8318-424e18382f94 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:07:29.876433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:29.877983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:29.879273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:29.879273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:29.879273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:07:29.879273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:07:29.879273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:07:29.879273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:07:29.879273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:07:29.879273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:07:29.879273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:29.879273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:29.879273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 615/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:29.886591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853f715-69eb-459a-8e2a-a9657e9f7410 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:29.935054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:29.993536 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853f715-69eb-459a-8e2a-a9657e9f7410 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:30.032712 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ad448-c5ce-4eda-93ed-ed61cea4655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:30.033712 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad448-c5ce-4eda-93ed-ed61cea4655c None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:30.034021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad448-c5ce-4eda-93ed-ed61cea4655c None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:30.034459 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad448-c5ce-4eda-93ed-ed61cea4655c None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:30.035357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ad448-c5ce-4eda-93ed-ed61cea4655c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:30.035778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ad448-c5ce-4eda-93ed-ed61cea4655c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:30.037553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ad448-c5ce-4eda-93ed-ed61cea4655c None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:30.062202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 612/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Jun 28 03:07:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:07:30.063331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1a337-def3-425c-8318-424e18382f94 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:30.175729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1a337-def3-425c-8318-424e18382f94 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:30.210715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31764e36-83bb-4210-8a7c-e27b2b92a5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:30.211530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764e36-83bb-4210-8a7c-e27b2b92a5bf None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:30.211823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764e36-83bb-4210-8a7c-e27b2b92a5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:30.212077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764e36-83bb-4210-8a7c-e27b2b92a5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:30.223240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31764e36-83bb-4210-8a7c-e27b2b92a5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:30.224822 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31764e36-83bb-4210-8a7c-e27b2b92a5bf None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-31764e36-83bb-4210-8a7c-e27b2b92a5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:30.244031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:30.245024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:30.245936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:30.245936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:30.245936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:30.245936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:30.245936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 616/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:07:30.251529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ad448-c5ce-4eda-93ed-ed61cea4655c None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:30.356596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ad448-c5ce-4eda-93ed-ed61cea4655c None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:30.358872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:30.395823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385465a-d9ae-4b0e-bd96-dc0794b0d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:30.396502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385465a-d9ae-4b0e-bd96-dc0794b0d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:30.396784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385465a-d9ae-4b0e-bd96-dc0794b0d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:30.397060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385465a-d9ae-4b0e-bd96-dc0794b0d7f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:30.397792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385465a-d9ae-4b0e-bd96-dc0794b0d7f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:30.398099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385465a-d9ae-4b0e-bd96-dc0794b0d7f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:30.399526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385465a-d9ae-4b0e-bd96-dc0794b0d7f1 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:30.411211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 613/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:07:30.417214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31764e36-83bb-4210-8a7c-e27b2b92a5bf None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:30.427578 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:30.527621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31764e36-83bb-4210-8a7c-e27b2b92a5bf None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:30.565135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706db4f3-2ad3-4902-a55d-f594b824d36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:30.566062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db4f3-2ad3-4902-a55d-f594b824d36a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:30.566302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db4f3-2ad3-4902-a55d-f594b824d36a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:30.566628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db4f3-2ad3-4902-a55d-f594b824d36a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:30.573770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706db4f3-2ad3-4902-a55d-f594b824d36a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:30.575318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706db4f3-2ad3-4902-a55d-f594b824d36a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-706db4f3-2ad3-4902-a55d-f594b824d36a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:07:30.590394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:30.591393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:30.592410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:07:30.592410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:07:30.592410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:07:30.592410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:07:30.592410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:07:30.592410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:07:30.592410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:30.592410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:30.592410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 617/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:07:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:07:30.598091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385465a-d9ae-4b0e-bd96-dc0794b0d7f1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:30.718306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385465a-d9ae-4b0e-bd96-dc0794b0d7f1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:30.757761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eba55-d22e-46dc-a958-914ff2f9ebd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:30.758539 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eba55-d22e-46dc-a958-914ff2f9ebd8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:30.758863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eba55-d22e-46dc-a958-914ff2f9ebd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:30.759157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eba55-d22e-46dc-a958-914ff2f9ebd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:30.760041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eba55-d22e-46dc-a958-914ff2f9ebd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:30.760353 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eba55-d22e-46dc-a958-914ff2f9ebd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:30.761905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eba55-d22e-46dc-a958-914ff2f9ebd8 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:30.775430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 614/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:07:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:30.781726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706db4f3-2ad3-4902-a55d-f594b824d36a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:30.857772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:30.895324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706db4f3-2ad3-4902-a55d-f594b824d36a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:30.933793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ba983-d493-43c3-953a-259634089e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:30.934905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ba983-d493-43c3-953a-259634089e5f None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:30.935241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ba983-d493-43c3-953a-259634089e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:30.935528 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ba983-d493-43c3-953a-259634089e5f None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/28b8048235c6421eae12ca99f80ed5ac/roles/a26fe2ec418e475fb65528485c92428a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:30.950924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ba983-d493-43c3-953a-259634089e5f None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=28b8048235c6421eae12ca99f80ed5ac, role_id=a26fe2ec418e475fb65528485c92428a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:30.952633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ba983-d493-43c3-953a-259634089e5f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:30.967351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 618/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:07:30 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/28b8048235c6421eae12ca99f80ed5ac/roles/a26fe2ec418e475fb65528485c92428a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:07:33.055125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40afbb4-a6d4-4ca6-9871-5f14d3fc0784 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:33.055561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40afbb4-a6d4-4ca6-9871-5f14d3fc0784 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:33.055662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40afbb4-a6d4-4ca6-9871-5f14d3fc0784 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:33.057186 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 615/1233] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:07:33.062700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088d060-ec73-4c1c-95cf-a85e5806ca44 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:33.063181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088d060-ec73-4c1c-95cf-a85e5806ca44 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:33.063279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088d060-ec73-4c1c-95cf-a85e5806ca44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:33.080318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e088d060-ec73-4c1c-95cf-a85e5806ca44 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:07:33.081543 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e088d060-ec73-4c1c-95cf-a85e5806ca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:07:33.156813 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 619/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:07:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:07:33.181823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40afbb4-a6d4-4ca6-9871-5f14d3fc0784 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:33.212379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:33.295453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40afbb4-a6d4-4ca6-9871-5f14d3fc0784 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:33.332810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d73b-ba23-43ae-a1d8-b0aca699ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:33.333603 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d73b-ba23-43ae-a1d8-b0aca699ef16 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:33.333879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d73b-ba23-43ae-a1d8-b0aca699ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:33.334184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d73b-ba23-43ae-a1d8-b0aca699ef16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:33.344456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d73b-ba23-43ae-a1d8-b0aca699ef16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-ffc3d73b-ba23-43ae-a1d8-b0aca699ef16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:07:33.352627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:33.353903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:33.354807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 616/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Jun 28 03:07:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:07:33.360536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088d060-ec73-4c1c-95cf-a85e5806ca44 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:33.407573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:33.464055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088d060-ec73-4c1c-95cf-a85e5806ca44 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:33.499397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d766a-a1c1-4f6b-8f0f-ab3b2bbc479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:33.500242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d766a-a1c1-4f6b-8f0f-ab3b2bbc479e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:33.500519 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d766a-a1c1-4f6b-8f0f-ab3b2bbc479e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:33.500796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d766a-a1c1-4f6b-8f0f-ab3b2bbc479e None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:33.501552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d766a-a1c1-4f6b-8f0f-ab3b2bbc479e None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:33.501906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d766a-a1c1-4f6b-8f0f-ab3b2bbc479e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:33.503386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d766a-a1c1-4f6b-8f0f-ab3b2bbc479e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:33.512199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 620/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Jun 28 03:07:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:33.518132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d73b-ba23-43ae-a1d8-b0aca699ef16 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:33.621587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:33.641497 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d73b-ba23-43ae-a1d8-b0aca699ef16 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:33.679308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fb587-da56-4eaa-9f62-58d5aa4aa4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:33.680115 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fb587-da56-4eaa-9f62-58d5aa4aa4cc None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:33.680400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fb587-da56-4eaa-9f62-58d5aa4aa4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:33.680670 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fb587-da56-4eaa-9f62-58d5aa4aa4cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:33.691456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fb587-da56-4eaa-9f62-58d5aa4aa4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:33.692902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fb587-da56-4eaa-9f62-58d5aa4aa4cc None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-614fb587-da56-4eaa-9f62-58d5aa4aa4cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:33.710187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:33.711414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:33.712588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:33.712588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:33.712588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:33.712588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:33.712588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 617/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:33.718216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d766a-a1c1-4f6b-8f0f-ab3b2bbc479e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:33.834439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d766a-a1c1-4f6b-8f0f-ab3b2bbc479e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:33.843901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:33.871517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536349c8-5aba-4dc6-b12f-3bee76d5f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:33.872278 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536349c8-5aba-4dc6-b12f-3bee76d5f234 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:33.872497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536349c8-5aba-4dc6-b12f-3bee76d5f234 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:33.872771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536349c8-5aba-4dc6-b12f-3bee76d5f234 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:33.873508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536349c8-5aba-4dc6-b12f-3bee76d5f234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:33.873813 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536349c8-5aba-4dc6-b12f-3bee76d5f234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:33.875234 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536349c8-5aba-4dc6-b12f-3bee76d5f234 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:33.887755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 621/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:07:33.894139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fb587-da56-4eaa-9f62-58d5aa4aa4cc None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:34.001134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fb587-da56-4eaa-9f62-58d5aa4aa4cc None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:34.039957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec17ff-81f1-49d6-aa45-4e27a53c3a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:34.040816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec17ff-81f1-49d6-aa45-4e27a53c3a60 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:34.041100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec17ff-81f1-49d6-aa45-4e27a53c3a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:34.041378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec17ff-81f1-49d6-aa45-4e27a53c3a60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:34.044793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:34.052181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec17ff-81f1-49d6-aa45-4e27a53c3a60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:34.053657 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec17ff-81f1-49d6-aa45-4e27a53c3a60 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-2fec17ff-81f1-49d6-aa45-4e27a53c3a60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:07:34.069174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:34.071114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:34.072275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:34.072275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:34.072275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:07:34.072275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:07:34.072275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:07:34.072275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:07:34.072275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:07:34.072275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:07:34.072275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:34.072275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:34.072275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 618/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:34.076450 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536349c8-5aba-4dc6-b12f-3bee76d5f234 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:34.184175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536349c8-5aba-4dc6-b12f-3bee76d5f234 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:34.223418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05c65-2c3a-4342-8f2b-16291ac52035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:34.224109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05c65-2c3a-4342-8f2b-16291ac52035 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:34.224391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05c65-2c3a-4342-8f2b-16291ac52035 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:34.224662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05c65-2c3a-4342-8f2b-16291ac52035 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:34.225501 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc05c65-2c3a-4342-8f2b-16291ac52035 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:34.225807 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc05c65-2c3a-4342-8f2b-16291ac52035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:34.227280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc05c65-2c3a-4342-8f2b-16291ac52035 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:34.246554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 622/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Jun 28 03:07:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:34.253333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec17ff-81f1-49d6-aa45-4e27a53c3a60 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:34.363136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec17ff-81f1-49d6-aa45-4e27a53c3a60 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:34.400209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d25c28-f0e8-4040-b835-b1c727d936c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:34.400885 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25c28-f0e8-4040-b835-b1c727d936c6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:34.401144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25c28-f0e8-4040-b835-b1c727d936c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:34.401411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25c28-f0e8-4040-b835-b1c727d936c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:34.472491 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:34.481526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d25c28-f0e8-4040-b835-b1c727d936c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:34.484023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d25c28-f0e8-4040-b835-b1c727d936c6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:34.593631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 619/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:07:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:07:34.599474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05c65-2c3a-4342-8f2b-16291ac52035 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:34.628078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:34.706571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05c65-2c3a-4342-8f2b-16291ac52035 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:34.745560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41e7e6-2882-4f8b-abd3-cc73d020d8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:34.745898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e7e6-2882-4f8b-abd3-cc73d020d8ac None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:34.746094 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e7e6-2882-4f8b-abd3-cc73d020d8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:34.746461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e7e6-2882-4f8b-abd3-cc73d020d8ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:34.757382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41e7e6-2882-4f8b-abd3-cc73d020d8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:34.758875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41e7e6-2882-4f8b-abd3-cc73d020d8ac None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-7c41e7e6-2882-4f8b-abd3-cc73d020d8ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:34.779453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:34.781974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:34.781974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:34.781974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:34.781974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:34.781974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 623/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:34.786752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d25c28-f0e8-4040-b835-b1c727d936c6 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:34.892023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:34.902209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d25c28-f0e8-4040-b835-b1c727d936c6 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:34.941572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3666d0-eb2a-4dfa-9463-e83d7ad1c107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:34.942334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3666d0-eb2a-4dfa-9463-e83d7ad1c107 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:34.942701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3666d0-eb2a-4dfa-9463-e83d7ad1c107 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:34.942969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3666d0-eb2a-4dfa-9463-e83d7ad1c107 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:34.943786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3666d0-eb2a-4dfa-9463-e83d7ad1c107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:34.944129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3666d0-eb2a-4dfa-9463-e83d7ad1c107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:34.945596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3666d0-eb2a-4dfa-9463-e83d7ad1c107 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:34.958363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 620/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:07:34.968095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41e7e6-2882-4f8b-abd3-cc73d020d8ac None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:35.062724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:35.089999 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41e7e6-2882-4f8b-abd3-cc73d020d8ac None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:35.131561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d2c5-645b-411f-bfbf-4f2bbc393f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:35.132394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d2c5-645b-411f-bfbf-4f2bbc393f8a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:35.132659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d2c5-645b-411f-bfbf-4f2bbc393f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:35.132877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d2c5-645b-411f-bfbf-4f2bbc393f8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:35.139690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774d2c5-645b-411f-bfbf-4f2bbc393f8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:35.141137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774d2c5-645b-411f-bfbf-4f2bbc393f8a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-4774d2c5-645b-411f-bfbf-4f2bbc393f8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:07:35.155649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:35.156776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:35.157928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:07:35.157928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:07:35.157928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:07:35.157928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:07:35.157928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:07:35.157928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:07:35.157928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:35.157928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:35.161923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 624/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:07:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:35.162951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3666d0-eb2a-4dfa-9463-e83d7ad1c107 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:35.274242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3666d0-eb2a-4dfa-9463-e83d7ad1c107 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:35.315855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ebc9e-37b3-4be6-9c9e-969091679b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:35.316568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ebc9e-37b3-4be6-9c9e-969091679b22 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:35.316848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ebc9e-37b3-4be6-9c9e-969091679b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:35.317116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ebc9e-37b3-4be6-9c9e-969091679b22 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:35.317905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ebc9e-37b3-4be6-9c9e-969091679b22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:35.318206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ebc9e-37b3-4be6-9c9e-969091679b22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:35.319670 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ebc9e-37b3-4be6-9c9e-969091679b22 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:35.334780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 621/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:07:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:35.340929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d2c5-645b-411f-bfbf-4f2bbc393f8a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:35.448193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d2c5-645b-411f-bfbf-4f2bbc393f8a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:35.491429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd567a-72c6-46f6-8318-3253f0f13bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:35.492118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd567a-72c6-46f6-8318-3253f0f13bce None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:35.492396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd567a-72c6-46f6-8318-3253f0f13bce None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:35.492722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd567a-72c6-46f6-8318-3253f0f13bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:35.493535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd567a-72c6-46f6-8318-3253f0f13bce None admin] RBAC: Adding query filter params (role.id=a26fe2ec418e475fb65528485c92428a, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=28b8048235c6421eae12ca99f80ed5ac) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:35.493843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd567a-72c6-46f6-8318-3253f0f13bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:35.495352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd567a-72c6-46f6-8318-3253f0f13bce None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:35.501619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 625/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:07:35 2022] GET /identity/v3/role_assignments?user.id=28b8048235c6421eae12ca99f80ed5ac&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=a26fe2ec418e475fb65528485c92428a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:07:37.783870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913435-2d53-45c4-b318-5e330b90844a None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:37.784447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913435-2d53-45c4-b318-5e330b90844a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:37.784447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913435-2d53-45c4-b318-5e330b90844a None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:37.785819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 622/1247] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:07:37.792574 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0ea56-6ecb-420f-96a5-80f19f09d643 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:37.793027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0ea56-6ecb-420f-96a5-80f19f09d643 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:37.793162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0ea56-6ecb-420f-96a5-80f19f09d643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:37.798675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:37.813650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-50e0ea56-6ecb-420f-96a5-80f19f09d643 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:07:37.815019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-50e0ea56-6ecb-420f-96a5-80f19f09d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:07:37.894867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 626/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:07:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:07:37.923237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97913435-2d53-45c4-b318-5e330b90844a None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:37.946039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:38.036130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97913435-2d53-45c4-b318-5e330b90844a None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:38.074616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a44ed-293d-443a-be01-ee3ac62683e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:38.075427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a44ed-293d-443a-be01-ee3ac62683e8 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:38.075709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a44ed-293d-443a-be01-ee3ac62683e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:38.076002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a44ed-293d-443a-be01-ee3ac62683e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:38.086505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a44ed-293d-443a-be01-ee3ac62683e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-885a44ed-293d-443a-be01-ee3ac62683e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:07:38.094204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:38.101586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:38.102541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 623/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:07:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:38.103247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0ea56-6ecb-420f-96a5-80f19f09d643 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:38.205701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0ea56-6ecb-420f-96a5-80f19f09d643 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:38.235515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:38.241070 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523d1cf-7f36-4d23-81e2-4189a746e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:38.241953 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523d1cf-7f36-4d23-81e2-4189a746e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:38.242284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523d1cf-7f36-4d23-81e2-4189a746e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:38.242725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523d1cf-7f36-4d23-81e2-4189a746e5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:38.243516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523d1cf-7f36-4d23-81e2-4189a746e5b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:38.243976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523d1cf-7f36-4d23-81e2-4189a746e5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:38.245361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523d1cf-7f36-4d23-81e2-4189a746e5b9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:38.254076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 627/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:07:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:38.260261 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a44ed-293d-443a-be01-ee3ac62683e8 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:38.353694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:38.379439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a44ed-293d-443a-be01-ee3ac62683e8 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:38.416181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fa2e3-5891-4d15-b91a-9178419ec9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:38.417297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fa2e3-5891-4d15-b91a-9178419ec9db None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:38.417641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fa2e3-5891-4d15-b91a-9178419ec9db None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:38.418014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fa2e3-5891-4d15-b91a-9178419ec9db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:38.429935 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fa2e3-5891-4d15-b91a-9178419ec9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:38.431877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fa2e3-5891-4d15-b91a-9178419ec9db None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-e24fa2e3-5891-4d15-b91a-9178419ec9db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:38.452867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:38.454011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:38.455257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:38.455257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:38.455257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:38.455257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:38.455257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 624/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:38.460416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523d1cf-7f36-4d23-81e2-4189a746e5b9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:38.577324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523d1cf-7f36-4d23-81e2-4189a746e5b9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:38.615145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b9efa-a4b6-4ec9-a5cd-c99e4c6fdb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:38.615908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b9efa-a4b6-4ec9-a5cd-c99e4c6fdb11 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:38.616190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b9efa-a4b6-4ec9-a5cd-c99e4c6fdb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:38.616461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b9efa-a4b6-4ec9-a5cd-c99e4c6fdb11 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:38.617201 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b9efa-a4b6-4ec9-a5cd-c99e4c6fdb11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:38.617507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b9efa-a4b6-4ec9-a5cd-c99e4c6fdb11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:38.619040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b9efa-a4b6-4ec9-a5cd-c99e4c6fdb11 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:38.632539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 628/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:38.638525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fa2e3-5891-4d15-b91a-9178419ec9db None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:38.756292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fa2e3-5891-4d15-b91a-9178419ec9db None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:38.788257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:38.797008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e41584-7171-4232-88bd-1fb6a8b8ae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:38.797826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e41584-7171-4232-88bd-1fb6a8b8ae75 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:38.798133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e41584-7171-4232-88bd-1fb6a8b8ae75 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:38.798448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e41584-7171-4232-88bd-1fb6a8b8ae75 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:38.807003 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e41584-7171-4232-88bd-1fb6a8b8ae75 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:38.808462 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e41584-7171-4232-88bd-1fb6a8b8ae75 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-75e41584-7171-4232-88bd-1fb6a8b8ae75 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:07:38.823715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:38.824975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:38.832223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:38.832223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:38.832223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:07:38.832223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:07:38.832223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:07:38.832223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:07:38.832223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:07:38.832223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:07:38.832223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:38.832223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:38.832223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 625/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:38.832975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b9efa-a4b6-4ec9-a5cd-c99e4c6fdb11 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:38.890678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:38.938956 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b9efa-a4b6-4ec9-a5cd-c99e4c6fdb11 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:38.975814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776161-5cd5-44aa-9ae1-43c6a3989a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:38.976511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776161-5cd5-44aa-9ae1-43c6a3989a2b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:38.976789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776161-5cd5-44aa-9ae1-43c6a3989a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:38.977064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776161-5cd5-44aa-9ae1-43c6a3989a2b None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:38.977907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8776161-5cd5-44aa-9ae1-43c6a3989a2b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:38.978215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8776161-5cd5-44aa-9ae1-43c6a3989a2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:38.979692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8776161-5cd5-44aa-9ae1-43c6a3989a2b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:38.997820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 629/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Jun 28 03:07:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:39.004019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e41584-7171-4232-88bd-1fb6a8b8ae75 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:39.117745 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e41584-7171-4232-88bd-1fb6a8b8ae75 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:39.157104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58461508-9917-44c0-8921-b6455c0691a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:39.157699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58461508-9917-44c0-8921-b6455c0691a1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:39.158025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58461508-9917-44c0-8921-b6455c0691a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:39.158318 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58461508-9917-44c0-8921-b6455c0691a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:39.219973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:39.234088 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58461508-9917-44c0-8921-b6455c0691a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:39.236039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58461508-9917-44c0-8921-b6455c0691a1 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:39.343792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 626/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:07:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:07:39.349748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776161-5cd5-44aa-9ae1-43c6a3989a2b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:39.459754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776161-5cd5-44aa-9ae1-43c6a3989a2b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:39.475495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:39.499790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53927-b3aa-47b3-92fa-9ad230171bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:39.500618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53927-b3aa-47b3-92fa-9ad230171bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:39.500889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53927-b3aa-47b3-92fa-9ad230171bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:39.501164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53927-b3aa-47b3-92fa-9ad230171bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:39.512356 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f53927-b3aa-47b3-92fa-9ad230171bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:39.513873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f53927-b3aa-47b3-92fa-9ad230171bd7 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-65f53927-b3aa-47b3-92fa-9ad230171bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:39.532681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:39.533720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:39.534736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:39.534736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:39.534736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:39.534736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:39.534736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 630/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:39.540435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58461508-9917-44c0-8921-b6455c0691a1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:39.640322 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:39.653596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58461508-9917-44c0-8921-b6455c0691a1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:39.703638 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5bf33-9462-458b-882d-d58d95a07cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:39.704314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5bf33-9462-458b-882d-d58d95a07cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:39.704598 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5bf33-9462-458b-882d-d58d95a07cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:39.704868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5bf33-9462-458b-882d-d58d95a07cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:39.705607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5bf33-9462-458b-882d-d58d95a07cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:39.705914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5bf33-9462-458b-882d-d58d95a07cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:39.707335 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5bf33-9462-458b-882d-d58d95a07cd1 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:39.722479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 627/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:39.730433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53927-b3aa-47b3-92fa-9ad230171bd7 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:39.846386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53927-b3aa-47b3-92fa-9ad230171bd7 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:39.890047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34448e9-1bdc-404c-94e9-29c4a9ff9412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:39.890899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34448e9-1bdc-404c-94e9-29c4a9ff9412 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:39.891179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34448e9-1bdc-404c-94e9-29c4a9ff9412 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:39.891449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34448e9-1bdc-404c-94e9-29c4a9ff9412 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:39.898699 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34448e9-1bdc-404c-94e9-29c4a9ff9412 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:39.900128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34448e9-1bdc-404c-94e9-29c4a9ff9412 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-e34448e9-1bdc-404c-94e9-29c4a9ff9412 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:07:39.915762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:39.917099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:39.918029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:07:39.918029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:07:39.918029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:07:39.918029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:07:39.918029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:07:39.918029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:07:39.918029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:39.918029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:39.918029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 631/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 03:07:39.922878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5bf33-9462-458b-882d-d58d95a07cd1 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:40.031632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5bf33-9462-458b-882d-d58d95a07cd1 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:40.076192 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f74f3-abaf-4745-af7f-182a572d37f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:40.077263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f74f3-abaf-4745-af7f-182a572d37f6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:40.077796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f74f3-abaf-4745-af7f-182a572d37f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:40.078010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f74f3-abaf-4745-af7f-182a572d37f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:40.079052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f74f3-abaf-4745-af7f-182a572d37f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:40.079485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f74f3-abaf-4745-af7f-182a572d37f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:40.081065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f74f3-abaf-4745-af7f-182a572d37f6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:40.096059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 628/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:07:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:40.102120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34448e9-1bdc-404c-94e9-29c4a9ff9412 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:40.130873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:40.210716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34448e9-1bdc-404c-94e9-29c4a9ff9412 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:40.245987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b406780-d69a-47bc-807d-b6f06990d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:40.246753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406780-d69a-47bc-807d-b6f06990d740 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:40.246994 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406780-d69a-47bc-807d-b6f06990d740 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:40.247246 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406780-d69a-47bc-807d-b6f06990d740 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:40.248080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b406780-d69a-47bc-807d-b6f06990d740 None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=28b8048235c6421eae12ca99f80ed5ac) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:40.248409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b406780-d69a-47bc-807d-b6f06990d740 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:40.250044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b406780-d69a-47bc-807d-b6f06990d740 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:40.255863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 632/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:07:40 2022] GET /identity/v3/role_assignments?user.id=28b8048235c6421eae12ca99f80ed5ac&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:42.384802 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894d28-b0a8-48fa-99fe-02ecfb0ba525 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:42.385698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894d28-b0a8-48fa-99fe-02ecfb0ba525 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:42.385698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894d28-b0a8-48fa-99fe-02ecfb0ba525 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:42.387990 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 629/1261] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:07:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:07:42.394222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a47b47-985b-4901-90a2-ee985e3da0e0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:42.394684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a47b47-985b-4901-90a2-ee985e3da0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:42.394799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a47b47-985b-4901-90a2-ee985e3da0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:42.419806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-93a47b47-985b-4901-90a2-ee985e3da0e0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:07:42.421222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-93a47b47-985b-4901-90a2-ee985e3da0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:07:42.498579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 633/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:07:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:07:42.521968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894d28-b0a8-48fa-99fe-02ecfb0ba525 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:42.536796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:42.634967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894d28-b0a8-48fa-99fe-02ecfb0ba525 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:42.669936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7bba5-0596-49d2-ac5b-142797ae45bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:42.670921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7bba5-0596-49d2-ac5b-142797ae45bb None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:42.671281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7bba5-0596-49d2-ac5b-142797ae45bb None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:42.671550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7bba5-0596-49d2-ac5b-142797ae45bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:42.682313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7bba5-0596-49d2-ac5b-142797ae45bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-57e7bba5-0596-49d2-ac5b-142797ae45bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:07:42.690060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:42.691147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:42.692232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 630/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:07:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:42.700010 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a47b47-985b-4901-90a2-ee985e3da0e0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:42.725625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:42.827835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a47b47-985b-4901-90a2-ee985e3da0e0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:42.863790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0317d-c3fe-4485-9ca9-d43850cc86ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:42.864461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0317d-c3fe-4485-9ca9-d43850cc86ac None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:42.864732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0317d-c3fe-4485-9ca9-d43850cc86ac None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:42.865004 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0317d-c3fe-4485-9ca9-d43850cc86ac None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:42.865748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0317d-c3fe-4485-9ca9-d43850cc86ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:42.866044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0317d-c3fe-4485-9ca9-d43850cc86ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:42.867448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0317d-c3fe-4485-9ca9-d43850cc86ac None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:42.875991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 634/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:07:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:42.882050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7bba5-0596-49d2-ac5b-142797ae45bb None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:42.957937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:42.997763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7bba5-0596-49d2-ac5b-142797ae45bb None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:43.038029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e6599-7c67-4fba-a01d-2b044d06ade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:43.039319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e6599-7c67-4fba-a01d-2b044d06ade5 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:43.039784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e6599-7c67-4fba-a01d-2b044d06ade5 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:43.040232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e6599-7c67-4fba-a01d-2b044d06ade5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:43.053263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e6599-7c67-4fba-a01d-2b044d06ade5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:43.054768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e6599-7c67-4fba-a01d-2b044d06ade5 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-a58e6599-7c67-4fba-a01d-2b044d06ade5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:43.072617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:43.073549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:43.074520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:43.074520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:43.074520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:43.074520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:43.074520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 631/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:43.080061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0317d-c3fe-4485-9ca9-d43850cc86ac None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:43.167356 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:43.187695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0317d-c3fe-4485-9ca9-d43850cc86ac None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:43.222376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1cfde-d5cb-4f10-b3ea-a7dea21f2884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:43.222985 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1cfde-d5cb-4f10-b3ea-a7dea21f2884 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:43.223268 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1cfde-d5cb-4f10-b3ea-a7dea21f2884 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:43.223544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1cfde-d5cb-4f10-b3ea-a7dea21f2884 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:43.224271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1cfde-d5cb-4f10-b3ea-a7dea21f2884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:43.224580 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1cfde-d5cb-4f10-b3ea-a7dea21f2884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:43.225955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1cfde-d5cb-4f10-b3ea-a7dea21f2884 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:43.238188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 635/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:43.247613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e6599-7c67-4fba-a01d-2b044d06ade5 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:43.354817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e6599-7c67-4fba-a01d-2b044d06ade5 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:43.375351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:43.391732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca6b30-0049-4758-9220-74592d8f4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:43.392785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6b30-0049-4758-9220-74592d8f4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:43.393057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6b30-0049-4758-9220-74592d8f4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:43.393319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6b30-0049-4758-9220-74592d8f4aa0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:43.401492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca6b30-0049-4758-9220-74592d8f4aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:43.402965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca6b30-0049-4758-9220-74592d8f4aa0 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-10ca6b30-0049-4758-9220-74592d8f4aa0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:07:43.417361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:43.418516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:43.419485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:43.419485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:43.419485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:07:43.419485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:07:43.419485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:07:43.419485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:07:43.419485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:07:43.419485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:07:43.419485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:43.419485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:43.419485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 632/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:43.425353 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1cfde-d5cb-4f10-b3ea-a7dea21f2884 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:43.535628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1cfde-d5cb-4f10-b3ea-a7dea21f2884 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:43.571285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8331-0b82-479d-a699-4ce617a6ecee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:43.571942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8331-0b82-479d-a699-4ce617a6ecee None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:43.572216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8331-0b82-479d-a699-4ce617a6ecee None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:43.572481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8331-0b82-479d-a699-4ce617a6ecee None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:43.573305 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a8331-0b82-479d-a699-4ce617a6ecee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:43.573608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a8331-0b82-479d-a699-4ce617a6ecee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:43.575055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a8331-0b82-479d-a699-4ce617a6ecee None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:43.584243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:43.597883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 636/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Jun 28 03:07:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:43.607181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca6b30-0049-4758-9220-74592d8f4aa0 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:43.725257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca6b30-0049-4758-9220-74592d8f4aa0 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:43.760480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fbc01-1cdc-4146-91de-7c5d305d633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:43.761295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fbc01-1cdc-4146-91de-7c5d305d633a None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:43.761577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fbc01-1cdc-4146-91de-7c5d305d633a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:43.761849 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fbc01-1cdc-4146-91de-7c5d305d633a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:43.773012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fbc01-1cdc-4146-91de-7c5d305d633a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:43.774504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fbc01-1cdc-4146-91de-7c5d305d633a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-bc7fbc01-1cdc-4146-91de-7c5d305d633a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:43.792399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:43.793421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:43.796380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:43.796380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:43.796380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:43.796380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:43.796380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 633/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:43.799738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8331-0b82-479d-a699-4ce617a6ecee None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:43.910523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8331-0b82-479d-a699-4ce617a6ecee None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:43.945959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee979fc4-b1ff-4880-b096-7e0902467132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:43.946647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979fc4-b1ff-4880-b096-7e0902467132 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:43.946933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979fc4-b1ff-4880-b096-7e0902467132 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:43.947203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979fc4-b1ff-4880-b096-7e0902467132 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:43.947933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee979fc4-b1ff-4880-b096-7e0902467132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:43.948239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee979fc4-b1ff-4880-b096-7e0902467132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:43.949653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee979fc4-b1ff-4880-b096-7e0902467132 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:43.961078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 637/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:43.967211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fbc01-1cdc-4146-91de-7c5d305d633a None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:44.001643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:44.076145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fbc01-1cdc-4146-91de-7c5d305d633a None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:44.111413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b69b2-4bca-428a-bf76-0b7fe1403b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:44.112205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b69b2-4bca-428a-bf76-0b7fe1403b0d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:44.112485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b69b2-4bca-428a-bf76-0b7fe1403b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:44.112752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b69b2-4bca-428a-bf76-0b7fe1403b0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:44.119651 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b69b2-4bca-428a-bf76-0b7fe1403b0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:44.121096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b69b2-4bca-428a-bf76-0b7fe1403b0d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-1d5b69b2-4bca-428a-bf76-0b7fe1403b0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:07:44.135364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:44.136354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:44.137372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:07:44.137372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:07:44.137372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:07:44.137372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:07:44.137372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:07:44.137372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:07:44.137372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:44.137372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:44.138667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 634/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:44.142728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee979fc4-b1ff-4880-b096-7e0902467132 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:44.203150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:44.251425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee979fc4-b1ff-4880-b096-7e0902467132 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:44.287664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c21d26-6f01-4152-8872-b1f6b95c400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:44.288314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c21d26-6f01-4152-8872-b1f6b95c400b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:44.288590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c21d26-6f01-4152-8872-b1f6b95c400b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:44.288856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c21d26-6f01-4152-8872-b1f6b95c400b None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:44.289634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c21d26-6f01-4152-8872-b1f6b95c400b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:44.289936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c21d26-6f01-4152-8872-b1f6b95c400b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:44.291405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c21d26-6f01-4152-8872-b1f6b95c400b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:44.304051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 638/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:44.310145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b69b2-4bca-428a-bf76-0b7fe1403b0d None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:44.405965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:44.421593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b69b2-4bca-428a-bf76-0b7fe1403b0d None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:44.457667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3498c0a-c776-4104-9410-b75c7019163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:44.458586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3498c0a-c776-4104-9410-b75c7019163e None admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:44.458864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3498c0a-c776-4104-9410-b75c7019163e None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:44.459158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3498c0a-c776-4104-9410-b75c7019163e None admin] PATH_INFO: `/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/28b8048235c6421eae12ca99f80ed5ac/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:44.461308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3498c0a-c776-4104-9410-b75c7019163e None admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ca3b00c04df2b20effc23b235e8d, user_id=28b8048235c6421eae12ca99f80ed5ac, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:44.462776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3498c0a-c776-4104-9410-b75c7019163e None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:44.478946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 635/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Jun 28 03:07:44 2022] PUT /identity/v3/projects/2b43ca3b00c04df2b20effc23b235e8d/users/28b8048235c6421eae12ca99f80ed5ac/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:07:46.451697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c96ac-4c26-45de-9f9b-9de540f07a15 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:46.452552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c96ac-4c26-45de-9f9b-9de540f07a15 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:46.452747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c96ac-4c26-45de-9f9b-9de540f07a15 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:46.455235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 639/1274] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:07:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:07:46.461582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6634dcb-af6e-42d0-9438-2d4783a3da05 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:46.462341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6634dcb-af6e-42d0-9438-2d4783a3da05 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:46.462436 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6634dcb-af6e-42d0-9438-2d4783a3da05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:46.481983 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-a6634dcb-af6e-42d0-9438-2d4783a3da05 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:07:46.483328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a6634dcb-af6e-42d0-9438-2d4783a3da05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:07:46.553689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 636/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:07:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:07:46.578191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c96ac-4c26-45de-9f9b-9de540f07a15 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:46.694857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c96ac-4c26-45de-9f9b-9de540f07a15 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:46.714357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:46.739217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee174d35-2a69-466b-97b4-fdecbed791e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:46.740038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee174d35-2a69-466b-97b4-fdecbed791e4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:46.740319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee174d35-2a69-466b-97b4-fdecbed791e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:46.740703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee174d35-2a69-466b-97b4-fdecbed791e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:46.752673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee174d35-2a69-466b-97b4-fdecbed791e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-ee174d35-2a69-466b-97b4-fdecbed791e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 03:07:46.760453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:46.761464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:46.762343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 640/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Jun 28 03:07:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:46.768133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6634dcb-af6e-42d0-9438-2d4783a3da05 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:46.854144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:46.874433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6634dcb-af6e-42d0-9438-2d4783a3da05 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:46.909057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7087d-fc62-4f6d-a8ae-f4382b67ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:46.909718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7087d-fc62-4f6d-a8ae-f4382b67ba40 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:46.909997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7087d-fc62-4f6d-a8ae-f4382b67ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:46.910267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7087d-fc62-4f6d-a8ae-f4382b67ba40 None admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:46.911048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7087d-fc62-4f6d-a8ae-f4382b67ba40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:46.911350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7087d-fc62-4f6d-a8ae-f4382b67ba40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:46.912727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7087d-fc62-4f6d-a8ae-f4382b67ba40 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:46.920715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 637/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Jun 28 03:07:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:46.930142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee174d35-2a69-466b-97b4-fdecbed791e4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:47.035358 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee174d35-2a69-466b-97b4-fdecbed791e4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:47.072208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e98a45-9618-46b3-bb2b-0fee29acf8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:47.073018 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e98a45-9618-46b3-bb2b-0fee29acf8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:47.073291 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e98a45-9618-46b3-bb2b-0fee29acf8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:47.073558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e98a45-9618-46b3-bb2b-0fee29acf8a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:47.084451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e98a45-9618-46b3-bb2b-0fee29acf8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:47.085893 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e98a45-9618-46b3-bb2b-0fee29acf8a5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c8e98a45-9618-46b3-bb2b-0fee29acf8a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:47.103189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:47.104199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:47.105285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:47.105285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:47.105285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:47.105285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:47.105285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 641/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:47.110998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7087d-fc62-4f6d-a8ae-f4382b67ba40 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:47.227255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7087d-fc62-4f6d-a8ae-f4382b67ba40 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:47.261913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55537af-1bfe-4c10-b382-1a765d74c5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:47.262610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55537af-1bfe-4c10-b382-1a765d74c5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:47.262880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55537af-1bfe-4c10-b382-1a765d74c5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:47.263147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55537af-1bfe-4c10-b382-1a765d74c5a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:47.264242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55537af-1bfe-4c10-b382-1a765d74c5a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:47.264537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55537af-1bfe-4c10-b382-1a765d74c5a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:47.265900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55537af-1bfe-4c10-b382-1a765d74c5a6 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:47.277570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 638/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:07:47.283544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e98a45-9618-46b3-bb2b-0fee29acf8a5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:47.319042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:47.391737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e98a45-9618-46b3-bb2b-0fee29acf8a5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:47.429484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518181-3469-497a-bc25-b015f1dc2886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:47.430282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518181-3469-497a-bc25-b015f1dc2886 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:47.430598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518181-3469-497a-bc25-b015f1dc2886 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:47.430869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518181-3469-497a-bc25-b015f1dc2886 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:47.438493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03518181-3469-497a-bc25-b015f1dc2886 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:47.439934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03518181-3469-497a-bc25-b015f1dc2886 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-03518181-3469-497a-bc25-b015f1dc2886 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 03:07:47.454214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:47.455721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:47.456683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:47.456683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:47.456683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 03:07:47.456683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 03:07:47.456683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 03:07:47.456683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 03:07:47.456683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 03:07:47.456683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 03:07:47.456683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 03:07:47.456683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:47.456683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 642/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:47.461568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55537af-1bfe-4c10-b382-1a765d74c5a6 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:47.466351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:47.571579 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55537af-1bfe-4c10-b382-1a765d74c5a6 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:47.607195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0987518-780b-4118-8e08-fc6be8996d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:47.607936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0987518-780b-4118-8e08-fc6be8996d61 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:47.608663 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0987518-780b-4118-8e08-fc6be8996d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:47.608937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0987518-780b-4118-8e08-fc6be8996d61 None admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:47.609767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0987518-780b-4118-8e08-fc6be8996d61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:47.610064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0987518-780b-4118-8e08-fc6be8996d61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:47.611887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0987518-780b-4118-8e08-fc6be8996d61 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:47.629183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 639/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Jun 28 03:07:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:47.635670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518181-3469-497a-bc25-b015f1dc2886 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:47.737495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:47.752040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518181-3469-497a-bc25-b015f1dc2886 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:47.790120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d7d91-3f37-4c47-b3a9-218dd7ec9a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:47.790806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7d91-3f37-4c47-b3a9-218dd7ec9a38 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:47.791081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7d91-3f37-4c47-b3a9-218dd7ec9a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:47.791343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7d91-3f37-4c47-b3a9-218dd7ec9a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:47.861532 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d7d91-3f37-4c47-b3a9-218dd7ec9a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:47.863005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d7d91-3f37-4c47-b3a9-218dd7ec9a38 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:47.972672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:47.983752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 643/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Jun 28 03:07:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 03:07:47.990132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0987518-780b-4118-8e08-fc6be8996d61 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:48.054233 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:48.099328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0987518-780b-4118-8e08-fc6be8996d61 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:48.147030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9e605-9a72-4a89-9ae5-6ae903f29605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:48.147738 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9e605-9a72-4a89-9ae5-6ae903f29605 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:48.148015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9e605-9a72-4a89-9ae5-6ae903f29605 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:48.148280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9e605-9a72-4a89-9ae5-6ae903f29605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:48.160866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9e605-9a72-4a89-9ae5-6ae903f29605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:48.162642 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9e605-9a72-4a89-9ae5-6ae903f29605 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-36a9e605-9a72-4a89-9ae5-6ae903f29605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 03:07:48.180781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:48.181816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:48.183036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 03:07:48.183036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 03:07:48.183036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 03:07:48.183036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:48.183036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 640/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:48.188558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d7d91-3f37-4c47-b3a9-218dd7ec9a38 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:48.293309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d7d91-3f37-4c47-b3a9-218dd7ec9a38 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:48.333603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a674d-eb18-418f-a5e8-8b38bbd6f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:48.334275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a674d-eb18-418f-a5e8-8b38bbd6f339 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:48.334593 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a674d-eb18-418f-a5e8-8b38bbd6f339 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:48.334869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a674d-eb18-418f-a5e8-8b38bbd6f339 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:48.335603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a674d-eb18-418f-a5e8-8b38bbd6f339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:48.335910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a674d-eb18-418f-a5e8-8b38bbd6f339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:48.337293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a674d-eb18-418f-a5e8-8b38bbd6f339 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:48.349402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 644/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Jun 28 03:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:48.357711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9e605-9a72-4a89-9ae5-6ae903f29605 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:48.465689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9e605-9a72-4a89-9ae5-6ae903f29605 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:48.481755 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:48.506561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdcc75-26bb-4156-b1a8-65fe8e4fc0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:48.507377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdcc75-26bb-4156-b1a8-65fe8e4fc0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:48.507658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdcc75-26bb-4156-b1a8-65fe8e4fc0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:48.507930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdcc75-26bb-4156-b1a8-65fe8e4fc0c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:48.515855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdcc75-26bb-4156-b1a8-65fe8e4fc0c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:48.517305 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdcc75-26bb-4156-b1a8-65fe8e4fc0c9 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application [None req-94bdcc75-26bb-4156-b1a8-65fe8e4fc0c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 03:07:48.532441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:48.533469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:48.535048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 03:07:48.535048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 03:07:48.535048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 03:07:48.535048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 03:07:48.535048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 03:07:48.535048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 03:07:48.535048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 03:07:48.535048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: ERROR keystone.server.flask.application Jun 28 03:07:48.535048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 641/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Jun 28 03:07:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:48.542606 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a674d-eb18-418f-a5e8-8b38bbd6f339 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:48.599873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:48.655868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a674d-eb18-418f-a5e8-8b38bbd6f339 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:48.693088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918aa2fe-7368-4041-8358-9eefd8ae77ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:48.693754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aa2fe-7368-4041-8358-9eefd8ae77ad None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:48.694033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aa2fe-7368-4041-8358-9eefd8ae77ad None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:48.694336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aa2fe-7368-4041-8358-9eefd8ae77ad None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:48.695225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918aa2fe-7368-4041-8358-9eefd8ae77ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:48.695537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918aa2fe-7368-4041-8358-9eefd8ae77ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:48.696984 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918aa2fe-7368-4041-8358-9eefd8ae77ad None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:48.710177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 645/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Jun 28 03:07:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:07:48.717357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdcc75-26bb-4156-b1a8-65fe8e4fc0c9 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:48.822737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdcc75-26bb-4156-b1a8-65fe8e4fc0c9 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:48.861991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83616bc6-f086-497b-80aa-bee4d10b8e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:48.862702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83616bc6-f086-497b-80aa-bee4d10b8e7b None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:48.862982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83616bc6-f086-497b-80aa-bee4d10b8e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:48.863264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83616bc6-f086-497b-80aa-bee4d10b8e7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:48.864097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83616bc6-f086-497b-80aa-bee4d10b8e7b None admin] RBAC: Adding query filter params (role.id=9a16cd7fa25141c181ae0defb7334ff2, scope.project.id=2b43ca3b00c04df2b20effc23b235e8d, user.id=28b8048235c6421eae12ca99f80ed5ac) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:48.864410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83616bc6-f086-497b-80aa-bee4d10b8e7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:48.865856 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83616bc6-f086-497b-80aa-bee4d10b8e7b None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:48.872487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 642/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Jun 28 03:07:48 2022] GET /identity/v3/role_assignments?user.id=28b8048235c6421eae12ca99f80ed5ac&scope.project.id=2b43ca3b00c04df2b20effc23b235e8d&role.id=9a16cd7fa25141c181ae0defb7334ff2 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:51.042826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8fe4e-269a-414c-8832-ef91e33900f2 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:51.043524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8fe4e-269a-414c-8832-ef91e33900f2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:51.043524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8fe4e-269a-414c-8832-ef91e33900f2 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:51.045437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 646/1288] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:07:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:07:51.052677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1bd7-a180-43a9-8fb1-aa1faa08dd12 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:51.053137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1bd7-a180-43a9-8fb1-aa1faa08dd12 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:51.053237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1bd7-a180-43a9-8fb1-aa1faa08dd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:51.078135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-352c1bd7-a180-43a9-8fb1-aa1faa08dd12 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:07:51.079377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-352c1bd7-a180-43a9-8fb1-aa1faa08dd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:07:51.112330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:51.160551 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 643/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:07:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:07:51.184093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8fe4e-269a-414c-8832-ef91e33900f2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:51.302033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8fe4e-269a-414c-8832-ef91e33900f2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:51.312863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:51.339718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad994214-2149-4ccf-ad66-ac1fa30c3e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:51.340536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad994214-2149-4ccf-ad66-ac1fa30c3e77 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:51.340814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad994214-2149-4ccf-ad66-ac1fa30c3e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:51.341081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad994214-2149-4ccf-ad66-ac1fa30c3e77 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:51.341740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad994214-2149-4ccf-ad66-ac1fa30c3e77 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:51.343316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad994214-2149-4ccf-ad66-ac1fa30c3e77 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-ad994214-2149-4ccf-ad66-ac1fa30c3e77 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:51.355169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:51.356414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:51.357346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 647/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Jun 28 03:07:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:51.363149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c1bd7-a180-43a9-8fb1-aa1faa08dd12 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:51.475380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c1bd7-a180-43a9-8fb1-aa1faa08dd12 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:51.517676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa833cd0-6293-4fda-8e97-714aaadc3e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:51.518344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833cd0-6293-4fda-8e97-714aaadc3e11 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:51.518657 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833cd0-6293-4fda-8e97-714aaadc3e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:51.518934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833cd0-6293-4fda-8e97-714aaadc3e11 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:51.519644 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa833cd0-6293-4fda-8e97-714aaadc3e11 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:51.519949 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa833cd0-6293-4fda-8e97-714aaadc3e11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:51.521321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa833cd0-6293-4fda-8e97-714aaadc3e11 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:51.527256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 644/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Jun 28 03:07:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:51.534603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad994214-2149-4ccf-ad66-ac1fa30c3e77 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:51.656333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad994214-2149-4ccf-ad66-ac1fa30c3e77 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:51.691842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298039f-6dac-423b-bc29-87d7de2c9f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:51.692500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298039f-6dac-423b-bc29-87d7de2c9f56 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:51.692779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298039f-6dac-423b-bc29-87d7de2c9f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:51.693054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298039f-6dac-423b-bc29-87d7de2c9f56 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:51.693765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298039f-6dac-423b-bc29-87d7de2c9f56 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:51.694072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298039f-6dac-423b-bc29-87d7de2c9f56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:51.695489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298039f-6dac-423b-bc29-87d7de2c9f56 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:51.700200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 648/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Jun 28 03:07:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:53.689083 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab7e4-f610-45b5-b3f0-1efef5e8931b None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:53.689979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab7e4-f610-45b5-b3f0-1efef5e8931b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:53.689979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab7e4-f610-45b5-b3f0-1efef5e8931b None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:53.692195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 645/1293] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:07:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:07:53.700711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf31ee-89be-4c2a-93f1-7303ffdb24ff None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:53.701141 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf31ee-89be-4c2a-93f1-7303ffdb24ff None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:53.701275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf31ee-89be-4c2a-93f1-7303ffdb24ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:53.725661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fdcf31ee-89be-4c2a-93f1-7303ffdb24ff None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:07:53.727040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fdcf31ee-89be-4c2a-93f1-7303ffdb24ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:07:53.766709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:53.813407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 649/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:07:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:07:53.836778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab7e4-f610-45b5-b3f0-1efef5e8931b None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:53.872858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:53.952252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab7e4-f610-45b5-b3f0-1efef5e8931b None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:53.995018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ae8f-34a3-4b61-985e-e52fd336184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:53.996071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ae8f-34a3-4b61-985e-e52fd336184a None admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:53.996534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ae8f-34a3-4b61-985e-e52fd336184a None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:53.996978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ae8f-34a3-4b61-985e-e52fd336184a None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:53.998145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ae8f-34a3-4b61-985e-e52fd336184a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:54.000374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ae8f-34a3-4b61-985e-e52fd336184a None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:54.018926 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 646/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Jun 28 03:07:53 2022] POST /identity/v3/services => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:07:56.035247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1c0f4-ba87-4273-a233-98a9ba685685 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:56.036148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1c0f4-ba87-4273-a233-98a9ba685685 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:56.036148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1c0f4-ba87-4273-a233-98a9ba685685 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:56.038248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 650/1296] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:07:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:07:56.045507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1052a81-a75f-4257-a0ab-4339a7dce5ef None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:56.045996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1052a81-a75f-4257-a0ab-4339a7dce5ef None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:56.046245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1052a81-a75f-4257-a0ab-4339a7dce5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:56.069030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-c1052a81-a75f-4257-a0ab-4339a7dce5ef None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:07:56.070226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c1052a81-a75f-4257-a0ab-4339a7dce5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:07:56.150614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 647/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:07:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:07:56.174234 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1c0f4-ba87-4273-a233-98a9ba685685 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:56.283015 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1c0f4-ba87-4273-a233-98a9ba685685 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:56.317990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b6f50-2c34-4ebf-8405-f01a5bacb322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:56.318752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b6f50-2c34-4ebf-8405-f01a5bacb322 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:56.319029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b6f50-2c34-4ebf-8405-f01a5bacb322 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:56.319296 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b6f50-2c34-4ebf-8405-f01a5bacb322 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:56.319949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b6f50-2c34-4ebf-8405-f01a5bacb322 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:56.321328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b6f50-2c34-4ebf-8405-f01a5bacb322 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-1a9b6f50-2c34-4ebf-8405-f01a5bacb322 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:56.333371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:56.334548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:56.335766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 651/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Jun 28 03:07:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:56.340712 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1052a81-a75f-4257-a0ab-4339a7dce5ef None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:56.359464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:56.442321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1052a81-a75f-4257-a0ab-4339a7dce5ef None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:56.477256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f77b2-1c7c-4e12-b1ab-b5807cce1712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:56.477913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f77b2-1c7c-4e12-b1ab-b5807cce1712 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:56.478196 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f77b2-1c7c-4e12-b1ab-b5807cce1712 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:56.478496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f77b2-1c7c-4e12-b1ab-b5807cce1712 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:56.479199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f77b2-1c7c-4e12-b1ab-b5807cce1712 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:56.479504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f77b2-1c7c-4e12-b1ab-b5807cce1712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:56.480875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f77b2-1c7c-4e12-b1ab-b5807cce1712 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:56.486585 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 648/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Jun 28 03:07:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:56.496240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b6f50-2c34-4ebf-8405-f01a5bacb322 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:56.537483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:56.609544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b6f50-2c34-4ebf-8405-f01a5bacb322 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:56.645202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3090b-d619-41ad-ba16-04746fe86e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:56.645857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3090b-d619-41ad-ba16-04746fe86e64 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:56.646134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3090b-d619-41ad-ba16-04746fe86e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:56.646406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3090b-d619-41ad-ba16-04746fe86e64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:56.647225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3090b-d619-41ad-ba16-04746fe86e64 None admin] RBAC: Adding query filter params (interface=public, service_id=eb63dd2de07049fb99fd5309867f0350, region_id=RegionOne) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:56.647535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3090b-d619-41ad-ba16-04746fe86e64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:56.648901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3090b-d619-41ad-ba16-04746fe86e64 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:56.654083 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 652/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Jun 28 03:07:56 2022] GET /identity/v3/endpoints?service_id=eb63dd2de07049fb99fd5309867f0350&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:56.659950 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f77b2-1c7c-4e12-b1ab-b5807cce1712 None admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:56.743324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:56.762844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f77b2-1c7c-4e12-b1ab-b5807cce1712 None admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:56.799446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90463c-c20d-40ba-bb66-f1c3b35c9910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:56.800111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90463c-c20d-40ba-bb66-f1c3b35c9910 None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:56.800393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90463c-c20d-40ba-bb66-f1c3b35c9910 None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:56.800663 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90463c-c20d-40ba-bb66-f1c3b35c9910 None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:56.801348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90463c-c20d-40ba-bb66-f1c3b35c9910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:56.802765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90463c-c20d-40ba-bb66-f1c3b35c9910 None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:56.809747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 649/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Jun 28 03:07:56 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:07:58.835363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647c88e-1417-42c5-8e41-cd258a6bf4aa None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:58.835955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647c88e-1417-42c5-8e41-cd258a6bf4aa None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:58.835955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647c88e-1417-42c5-8e41-cd258a6bf4aa None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:58.837302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 653/1302] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:07:58.843909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb6178-3201-44e2-9621-8a77522db165 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:58.844641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb6178-3201-44e2-9621-8a77522db165 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:58.844810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb6178-3201-44e2-9621-8a77522db165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:58.870714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-bbbb6178-3201-44e2-9621-8a77522db165 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:07:58.871892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bbbb6178-3201-44e2-9621-8a77522db165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:07:58.943021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 650/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:07:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 03:07:58.967126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647c88e-1417-42c5-8e41-cd258a6bf4aa None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:59.082055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:59.090198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647c88e-1417-42c5-8e41-cd258a6bf4aa None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:59.129071 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bd546-2671-4c7b-8894-6f45bbd8bdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:59.129885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd546-2671-4c7b-8894-6f45bbd8bdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:59.130171 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd546-2671-4c7b-8894-6f45bbd8bdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:59.130480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd546-2671-4c7b-8894-6f45bbd8bdb9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:59.131140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bd546-2671-4c7b-8894-6f45bbd8bdb9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:59.132528 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bd546-2671-4c7b-8894-6f45bbd8bdb9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b72bd546-2671-4c7b-8894-6f45bbd8bdb9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 03:07:59.144810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 03:07:59.145962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 28 03:07:59.146892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 654/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Jun 28 03:07:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 03:07:59.152504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb6178-3201-44e2-9621-8a77522db165 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:59.232969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:07:59.257317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb6178-3201-44e2-9621-8a77522db165 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:59.303530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee148-df72-42a0-affe-b6b06d87692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:59.304190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee148-df72-42a0-affe-b6b06d87692d None admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:59.304461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee148-df72-42a0-affe-b6b06d87692d None admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:59.304726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee148-df72-42a0-affe-b6b06d87692d None admin] PATH_INFO: `/v3/services` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:59.305430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee148-df72-42a0-affe-b6b06d87692d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:07:59.305734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee148-df72-42a0-affe-b6b06d87692d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:59.307125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee148-df72-42a0-affe-b6b06d87692d None admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:59.312845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 651/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Jun 28 03:07:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:07:59.321191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bd546-2671-4c7b-8894-6f45bbd8bdb9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:07:59.426426 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bd546-2671-4c7b-8894-6f45bbd8bdb9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:07:59.461131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1677d4-5283-4d53-b5e2-87edbb2bc8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:07:59.461788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1677d4-5283-4d53-b5e2-87edbb2bc8a2 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:07:59.462063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1677d4-5283-4d53-b5e2-87edbb2bc8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:07:59.462336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1677d4-5283-4d53-b5e2-87edbb2bc8a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:07:59.463077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1677d4-5283-4d53-b5e2-87edbb2bc8a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:07:59.464445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1677d4-5283-4d53-b5e2-87edbb2bc8a2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:07:59.492213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 655/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Jun 28 03:07:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:08:09.309373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=30 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:08:09.485356 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:02.894669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd25b7-1d82-4845-8d83-cfd0eca502ae None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:02.895673 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd25b7-1d82-4845-8d83-cfd0eca502ae None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:02.896161 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd25b7-1d82-4845-8d83-cfd0eca502ae None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:02.897778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 652/1307] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:02.903180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89983766-2740-4c92-8503-85f2f2bc35f9 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:02.904020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89983766-2740-4c92-8503-85f2f2bc35f9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:02.904020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89983766-2740-4c92-8503-85f2f2bc35f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:03.071423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-89983766-2740-4c92-8503-85f2f2bc35f9 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:03.072657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-89983766-2740-4c92-8503-85f2f2bc35f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:03.228976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 656/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:03.289087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dd214-85fa-4163-978a-4365efe17788 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:03.289600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dd214-85fa-4163-978a-4365efe17788 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:03.289600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dd214-85fa-4163-978a-4365efe17788 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:03.291024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 653/1309] 10.222.0.23 () {54 vars in 964 bytes} [Tue Jun 28 03:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:03.297733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd471b-0591-44f5-b4a4-0c971d6aef72 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:03.298071 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd471b-0591-44f5-b4a4-0c971d6aef72 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:03.298337 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd471b-0591-44f5-b4a4-0c971d6aef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:03.390693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-82cd471b-0591-44f5-b4a4-0c971d6aef72 None None] MFA Rules not processed for user `d7e0632bc12346b38663a0ef97ab1a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:03.391947 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-82cd471b-0591-44f5-b4a4-0c971d6aef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:03.414923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:03.487514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 657/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Tue Jun 28 03:09:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:09:03.488295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dd214-85fa-4163-978a-4365efe17788 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:03.490051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c01dd214-85fa-4163-978a-4365efe17788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:03.626501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dd214-85fa-4163-978a-4365efe17788 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:03.727610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2cced-e159-4e8a-81e8-62dd38d5fa23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:03.728375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2cced-e159-4e8a-81e8-62dd38d5fa23 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:03.728860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2cced-e159-4e8a-81e8-62dd38d5fa23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:03.729284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2cced-e159-4e8a-81e8-62dd38d5fa23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:03.731423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d9a2cced-e159-4e8a-81e8-62dd38d5fa23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:03.798322 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:03.872357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2cced-e159-4e8a-81e8-62dd38d5fa23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:03.874425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2cced-e159-4e8a-81e8-62dd38d5fa23 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:03.899490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 654/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:09:06.231376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea7170-d813-4be2-be40-ca305be09976 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:06.232081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea7170-d813-4be2-be40-ca305be09976 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:06.232081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea7170-d813-4be2-be40-ca305be09976 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:06.233881 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 658/1312] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:06.239270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca47e67-b2ee-43d4-9542-04791ab8fb07 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:06.239769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca47e67-b2ee-43d4-9542-04791ab8fb07 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:06.239854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca47e67-b2ee-43d4-9542-04791ab8fb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:06.324701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-eca47e67-b2ee-43d4-9542-04791ab8fb07 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:06.325914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-eca47e67-b2ee-43d4-9542-04791ab8fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:06.426192 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 655/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:06.464015 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea7170-d813-4be2-be40-ca305be09976 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:06.465880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a6ea7170-d813-4be2-be40-ca305be09976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:06.587296 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea7170-d813-4be2-be40-ca305be09976 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:06.661530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:06.664247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df764ba-2102-42fa-b8cc-f0d831ac909c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:06.664911 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df764ba-2102-42fa-b8cc-f0d831ac909c service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:06.665238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df764ba-2102-42fa-b8cc-f0d831ac909c service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:06.665571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df764ba-2102-42fa-b8cc-f0d831ac909c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:06.667862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8df764ba-2102-42fa-b8cc-f0d831ac909c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:06.785178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df764ba-2102-42fa-b8cc-f0d831ac909c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:06.786694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df764ba-2102-42fa-b8cc-f0d831ac909c service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:06.805046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 659/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:09:09.135999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873069f-f0d0-44fc-bf9d-62717db52e66 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:09.136528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873069f-f0d0-44fc-bf9d-62717db52e66 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:09.136528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873069f-f0d0-44fc-bf9d-62717db52e66 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:09.137879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 656/1315] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:09.144294 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02732519-7eb4-45eb-b25a-2f6a67c564c2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:09.145015 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02732519-7eb4-45eb-b25a-2f6a67c564c2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:09.145162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02732519-7eb4-45eb-b25a-2f6a67c564c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:09.220796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-02732519-7eb4-45eb-b25a-2f6a67c564c2 None None] MFA Rules not processed for user `33ca46aa10824dbdb4be243951ab25d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:09.222014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-02732519-7eb4-45eb-b25a-2f6a67c564c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:09.274760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:09.323763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 660/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:09.364715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873069f-f0d0-44fc-bf9d-62717db52e66 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:09.366248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8873069f-f0d0-44fc-bf9d-62717db52e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:09.377174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:09.489506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873069f-f0d0-44fc-bf9d-62717db52e66 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:09.563903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ebf26-ff71-4347-87cb-9abbaa66b8cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:09.564548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ebf26-ff71-4347-87cb-9abbaa66b8cf service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:09.564822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ebf26-ff71-4347-87cb-9abbaa66b8cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:09.565090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ebf26-ff71-4347-87cb-9abbaa66b8cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:09.566764 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a74ebf26-ff71-4347-87cb-9abbaa66b8cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:09.629933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:09.690204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ebf26-ff71-4347-87cb-9abbaa66b8cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:09.691708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ebf26-ff71-4347-87cb-9abbaa66b8cf service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:09.711017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 657/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:09:12.284115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18019e-f981-42ba-955a-2a565fdf3173 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:12.284974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18019e-f981-42ba-955a-2a565fdf3173 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:12.284974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18019e-f981-42ba-955a-2a565fdf3173 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:12.287243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 661/1318] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:12.295325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbb47-8c37-4fd8-8796-88180f4d16e0 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:12.295766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbb47-8c37-4fd8-8796-88180f4d16e0 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:12.295877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbb47-8c37-4fd8-8796-88180f4d16e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:12.361242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6c4cbb47-8c37-4fd8-8796-88180f4d16e0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:12.362489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6c4cbb47-8c37-4fd8-8796-88180f4d16e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:12.469012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 658/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:09:12.524680 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd16f-e29e-4814-a5b3-c64e82f8f1ad None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:12.524933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd16f-e29e-4814-a5b3-c64e82f8f1ad None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:12.525227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd16f-e29e-4814-a5b3-c64e82f8f1ad None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:12.526643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 662/1320] 10.222.0.23 () {54 vars in 964 bytes} [Tue Jun 28 03:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:12.533277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3188b9-62e0-4a5a-961c-f0aab0a9be35 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:12.533563 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3188b9-62e0-4a5a-961c-f0aab0a9be35 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:12.533835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3188b9-62e0-4a5a-961c-f0aab0a9be35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:12.558952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:12.629576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-fa3188b9-62e0-4a5a-961c-f0aab0a9be35 None None] MFA Rules not processed for user `d7e0632bc12346b38663a0ef97ab1a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:12.630749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fa3188b9-62e0-4a5a-961c-f0aab0a9be35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:12.710749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 659/1321] 10.222.0.23 () {58 vars in 1061 bytes} [Tue Jun 28 03:09:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:12.720344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dd16f-e29e-4814-a5b3-c64e82f8f1ad None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:12.722147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4f9dd16f-e29e-4814-a5b3-c64e82f8f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:12.849302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dd16f-e29e-4814-a5b3-c64e82f8f1ad None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:12.927716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64860f1-f0e6-4724-b60a-ebb793a9f949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:12.928355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64860f1-f0e6-4724-b60a-ebb793a9f949 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:12.928624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64860f1-f0e6-4724-b60a-ebb793a9f949 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:12.928889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64860f1-f0e6-4724-b60a-ebb793a9f949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:12.930532 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a64860f1-f0e6-4724-b60a-ebb793a9f949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:12.938683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:13.051523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64860f1-f0e6-4724-b60a-ebb793a9f949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:13.053029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64860f1-f0e6-4724-b60a-ebb793a9f949 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:13.073701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 663/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:09:16.225371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0b277-daca-4622-80e2-98460d5aa6a7 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:16.225969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0b277-daca-4622-80e2-98460d5aa6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:16.225969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0b277-daca-4622-80e2-98460d5aa6a7 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:16.227317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 660/1323] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:16.232856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292dd99-cc70-40dd-b958-726051f73361 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:16.233648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292dd99-cc70-40dd-b958-726051f73361 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:16.233777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292dd99-cc70-40dd-b958-726051f73361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:16.303103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3292dd99-cc70-40dd-b958-726051f73361 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:16.304235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3292dd99-cc70-40dd-b958-726051f73361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:16.366422 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:16.411243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 664/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:16.447383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0b277-daca-4622-80e2-98460d5aa6a7 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:16.448947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-64b0b277-daca-4622-80e2-98460d5aa6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:16.564661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0b277-daca-4622-80e2-98460d5aa6a7 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:16.578361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:16.642238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb92d2-0724-4b20-91dc-af681c1d1219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:16.642940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb92d2-0724-4b20-91dc-af681c1d1219 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:16.643186 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb92d2-0724-4b20-91dc-af681c1d1219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:16.643470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb92d2-0724-4b20-91dc-af681c1d1219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:16.645110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bdcb92d2-0724-4b20-91dc-af681c1d1219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:16.759248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb92d2-0724-4b20-91dc-af681c1d1219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:16.760707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb92d2-0724-4b20-91dc-af681c1d1219 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:16.780440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 661/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:09:18.845713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d742b3-619a-42c1-87a5-2d0d18571ceb None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:18.846271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d742b3-619a-42c1-87a5-2d0d18571ceb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:18.846271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d742b3-619a-42c1-87a5-2d0d18571ceb None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:18.847531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 665/1326] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:18.853016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cbcc3-d51c-4e5f-83e6-e6d584c9af73 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:18.853437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cbcc3-d51c-4e5f-83e6-e6d584c9af73 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:18.853531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cbcc3-d51c-4e5f-83e6-e6d584c9af73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:18.903082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:18.923376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-a10cbcc3-d51c-4e5f-83e6-e6d584c9af73 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:18.924585 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a10cbcc3-d51c-4e5f-83e6-e6d584c9af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:19.025254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 662/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:19.064899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d742b3-619a-42c1-87a5-2d0d18571ceb None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:19.066610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-71d742b3-619a-42c1-87a5-2d0d18571ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:19.176350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d742b3-619a-42c1-87a5-2d0d18571ceb None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:19.257001 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bef196-6fa5-4ae0-8092-85027d684ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:19.257616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bef196-6fa5-4ae0-8092-85027d684ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:19.257894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bef196-6fa5-4ae0-8092-85027d684ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:19.258169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bef196-6fa5-4ae0-8092-85027d684ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:19.259947 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e2bef196-6fa5-4ae0-8092-85027d684ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:19.277913 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:19.379544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bef196-6fa5-4ae0-8092-85027d684ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:19.381268 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bef196-6fa5-4ae0-8092-85027d684ef7 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:19.399590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 666/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:09:21.496368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2d5da-b201-4782-8998-cb67bb3bc4e7 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:21.497034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2d5da-b201-4782-8998-cb67bb3bc4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:21.497034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2d5da-b201-4782-8998-cb67bb3bc4e7 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:21.498461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 663/1329] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:21.503868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32511-8006-494c-aa4c-848379e77183 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:21.504288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32511-8006-494c-aa4c-848379e77183 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:21.504416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32511-8006-494c-aa4c-848379e77183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:21.572746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-bfc32511-8006-494c-aa4c-848379e77183 None None] MFA Rules not processed for user `33ca46aa10824dbdb4be243951ab25d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:21.573930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bfc32511-8006-494c-aa4c-848379e77183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:21.646545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:21.681423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 667/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:21.719768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2d5da-b201-4782-8998-cb67bb3bc4e7 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:21.721358 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-09f2d5da-b201-4782-8998-cb67bb3bc4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:21.831797 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2d5da-b201-4782-8998-cb67bb3bc4e7 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:21.852202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:21.912870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994b00b-d982-4e18-894e-a962ae0e7b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:21.913540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b00b-d982-4e18-894e-a962ae0e7b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:21.913799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b00b-d982-4e18-894e-a962ae0e7b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:21.914066 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b00b-d982-4e18-894e-a962ae0e7b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:21.915748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1994b00b-d982-4e18-894e-a962ae0e7b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:22.030635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994b00b-d982-4e18-894e-a962ae0e7b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:22.032082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994b00b-d982-4e18-894e-a962ae0e7b79 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:22.051969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 664/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:09:24.404814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13a74e-70cc-4066-af96-8a8c227419ab None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:24.405710 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13a74e-70cc-4066-af96-8a8c227419ab None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:24.405710 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13a74e-70cc-4066-af96-8a8c227419ab None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:24.407870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 668/1332] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:24.413351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa47e0-6f62-424d-bfc1-5d9b668889f3 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:24.413800 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa47e0-6f62-424d-bfc1-5d9b668889f3 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:24.413894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa47e0-6f62-424d-bfc1-5d9b668889f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:24.480352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:24.484149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-79fa47e0-6f62-424d-bfc1-5d9b668889f3 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:24.485757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-79fa47e0-6f62-424d-bfc1-5d9b668889f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:24.601345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 665/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:24.641485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13a74e-70cc-4066-af96-8a8c227419ab None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:24.643994 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6a13a74e-70cc-4066-af96-8a8c227419ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:24.779314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13a74e-70cc-4066-af96-8a8c227419ab None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:24.853614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c8a1a-aee1-4387-8722-404aa94c4006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:24.854266 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c8a1a-aee1-4387-8722-404aa94c4006 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:24.854576 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c8a1a-aee1-4387-8722-404aa94c4006 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:24.854845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c8a1a-aee1-4387-8722-404aa94c4006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:24.856624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ea9c8a1a-aee1-4387-8722-404aa94c4006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:24.885248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:24.975247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c8a1a-aee1-4387-8722-404aa94c4006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:24.976743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c8a1a-aee1-4387-8722-404aa94c4006 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:24.996258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 669/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:09:27.056364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082ade0-6e76-4066-b7c7-4800481ae8b2 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:27.056845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082ade0-6e76-4066-b7c7-4800481ae8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:27.056951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082ade0-6e76-4066-b7c7-4800481ae8b2 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:27.058319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 666/1335] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:27.065665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ba09-37af-4a90-aa12-39f2a83ebba4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:27.066104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ba09-37af-4a90-aa12-39f2a83ebba4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:27.066231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ba09-37af-4a90-aa12-39f2a83ebba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:27.140534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6ff2ba09-37af-4a90-aa12-39f2a83ebba4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:27.141648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6ff2ba09-37af-4a90-aa12-39f2a83ebba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:27.224682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:27.248486 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 670/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:27.291237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082ade0-6e76-4066-b7c7-4800481ae8b2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:27.292781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6082ade0-6e76-4066-b7c7-4800481ae8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:27.411987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082ade0-6e76-4066-b7c7-4800481ae8b2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:27.444814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:27.501355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ce385-d61c-4482-a583-aade2231cd43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:27.502010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ce385-d61c-4482-a583-aade2231cd43 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:27.502280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ce385-d61c-4482-a583-aade2231cd43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:27.502583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ce385-d61c-4482-a583-aade2231cd43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:27.504201 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3f8ce385-d61c-4482-a583-aade2231cd43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:27.618122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ce385-d61c-4482-a583-aade2231cd43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:27.619578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ce385-d61c-4482-a583-aade2231cd43 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:27.640502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 667/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:09:30.024575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3713175-4272-4c74-8c92-f019dd3ce8ef None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:30.025456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3713175-4272-4c74-8c92-f019dd3ce8ef None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:30.025456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3713175-4272-4c74-8c92-f019dd3ce8ef None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:30.027747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 671/1338] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:30.036696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe633d-b2c0-416a-8f5f-a66997e9fbe3 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:30.037122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe633d-b2c0-416a-8f5f-a66997e9fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:30.037254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe633d-b2c0-416a-8f5f-a66997e9fbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:30.116223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-84fe633d-b2c0-416a-8f5f-a66997e9fbe3 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:30.117444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-84fe633d-b2c0-416a-8f5f-a66997e9fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:30.126333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:30.226096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 668/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:30.264767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3713175-4272-4c74-8c92-f019dd3ce8ef None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:30.266309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b3713175-4272-4c74-8c92-f019dd3ce8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:30.375785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3713175-4272-4c74-8c92-f019dd3ce8ef None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:30.449488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b690cb6-0a6c-42e9-b26e-9ec5bc38fdb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:30.450143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690cb6-0a6c-42e9-b26e-9ec5bc38fdb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:30.450682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690cb6-0a6c-42e9-b26e-9ec5bc38fdb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:30.450979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690cb6-0a6c-42e9-b26e-9ec5bc38fdb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:30.452661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6b690cb6-0a6c-42e9-b26e-9ec5bc38fdb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:30.489180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:30.566462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690cb6-0a6c-42e9-b26e-9ec5bc38fdb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:30.567913 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690cb6-0a6c-42e9-b26e-9ec5bc38fdb7 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:30.586331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 672/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:09:34.669800 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9b27b-47ce-4cf3-b801-34b5d9c5aa6b None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:34.670363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9b27b-47ce-4cf3-b801-34b5d9c5aa6b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:34.670569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9b27b-47ce-4cf3-b801-34b5d9c5aa6b None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:34.672115 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 669/1341] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:34.677554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d0025-e8cc-4af1-9f04-7368d8048785 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:34.677962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d0025-e8cc-4af1-9f04-7368d8048785 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:34.678108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d0025-e8cc-4af1-9f04-7368d8048785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:34.760251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-647d0025-e8cc-4af1-9f04-7368d8048785 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:34.761817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-647d0025-e8cc-4af1-9f04-7368d8048785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:34.856921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:34.870896 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 673/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:34.908881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9b27b-47ce-4cf3-b801-34b5d9c5aa6b None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:34.911357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-41e9b27b-47ce-4cf3-b801-34b5d9c5aa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:35.009091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9b27b-47ce-4cf3-b801-34b5d9c5aa6b None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:35.012694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d110c-e371-4029-bd64-2f8c2f92a1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:35.013350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d110c-e371-4029-bd64-2f8c2f92a1ae service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:35.013624 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d110c-e371-4029-bd64-2f8c2f92a1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:35.013892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d110c-e371-4029-bd64-2f8c2f92a1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:35.023252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d110c-e371-4029-bd64-2f8c2f92a1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:35.024677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d110c-e371-4029-bd64-2f8c2f92a1ae service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:35.034069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 670/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:09:37.708142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad26d0-240b-468c-a154-71c487c68cfb None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:37.708708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad26d0-240b-468c-a154-71c487c68cfb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:37.708708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad26d0-240b-468c-a154-71c487c68cfb None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:37.710082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 674/1344] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:37.715486 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae13f21-a6fe-4394-99af-cc298cabd70c None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:37.716026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae13f21-a6fe-4394-99af-cc298cabd70c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:37.716357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae13f21-a6fe-4394-99af-cc298cabd70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:37.756102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-1ae13f21-a6fe-4394-99af-cc298cabd70c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:37.757445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1ae13f21-a6fe-4394-99af-cc298cabd70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:37.790849 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:37.847371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 671/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:37.885594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad26d0-240b-468c-a154-71c487c68cfb None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:37.898141 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad26d0-240b-468c-a154-71c487c68cfb None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:37.901780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d54bf3-ba73-4240-b20f-e53fe7244fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:37.902470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d54bf3-ba73-4240-b20f-e53fe7244fbc service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:37.902749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d54bf3-ba73-4240-b20f-e53fe7244fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:37.903050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d54bf3-ba73-4240-b20f-e53fe7244fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:37.913103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d54bf3-ba73-4240-b20f-e53fe7244fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:37.914599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d54bf3-ba73-4240-b20f-e53fe7244fbc service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:37.925883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 675/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:09:42.051727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c1b92-9a87-444b-866b-64e49dfb2acd None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:42.052199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c1b92-9a87-444b-866b-64e49dfb2acd None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:42.052399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c1b92-9a87-444b-866b-64e49dfb2acd None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:42.053877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 672/1347] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:42.060271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6bc82-2d65-4b78-8ad0-82c670895b28 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:42.060271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6bc82-2d65-4b78-8ad0-82c670895b28 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:42.060271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6bc82-2d65-4b78-8ad0-82c670895b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:42.078823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-89d6bc82-2d65-4b78-8ad0-82c670895b28 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:42.080065 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-89d6bc82-2d65-4b78-8ad0-82c670895b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:42.088844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 676/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:42.127856 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c1b92-9a87-444b-866b-64e49dfb2acd None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:42.129812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b35c1b92-9a87-444b-866b-64e49dfb2acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:42.144711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c1b92-9a87-444b-866b-64e49dfb2acd None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:42.148470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3400d3-07a4-4300-9dcd-fb0a8cbf6c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:42.149128 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3400d3-07a4-4300-9dcd-fb0a8cbf6c56 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:42.149417 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3400d3-07a4-4300-9dcd-fb0a8cbf6c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:42.149698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3400d3-07a4-4300-9dcd-fb0a8cbf6c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:42.163214 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3400d3-07a4-4300-9dcd-fb0a8cbf6c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:42.164703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3400d3-07a4-4300-9dcd-fb0a8cbf6c56 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:42.174684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 673/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:09:47.220758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d46db-3938-47f1-9652-ef07d79edae7 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:47.221238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d46db-3938-47f1-9652-ef07d79edae7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:47.221238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d46db-3938-47f1-9652-ef07d79edae7 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:47.223912 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 677/1350] 10.222.0.23 () {54 vars in 921 bytes} [Tue Jun 28 03:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:47.233525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406e55f-30d7-4d6a-a740-0448a604c161 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:47.234010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406e55f-30d7-4d6a-a740-0448a604c161 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:47.234090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406e55f-30d7-4d6a-a740-0448a604c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:47.309016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5406e55f-30d7-4d6a-a740-0448a604c161 None None] MFA Rules not processed for user `28b8048235c6421eae12ca99f80ed5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:47.310386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5406e55f-30d7-4d6a-a740-0448a604c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:47.390810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 674/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Jun 28 03:09:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:51.493013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee5457-a456-4b9c-82da-3b013858787d None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:51.493596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee5457-a456-4b9c-82da-3b013858787d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:51.493596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee5457-a456-4b9c-82da-3b013858787d None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:51.495239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 678/1352] 10.222.0.23 () {54 vars in 921 bytes} [Tue Jun 28 03:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:51.500682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce3c6-eb54-49f4-89c4-7c3e8c470f11 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:51.501132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce3c6-eb54-49f4-89c4-7c3e8c470f11 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:51.501333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce3c6-eb54-49f4-89c4-7c3e8c470f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:51.521866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-2d8ce3c6-eb54-49f4-89c4-7c3e8c470f11 None None] MFA Rules not processed for user `28b8048235c6421eae12ca99f80ed5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:51.523471 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-2d8ce3c6-eb54-49f4-89c4-7c3e8c470f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:51.533460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 675/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Jun 28 03:09:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:52.073142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=13 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:52.982909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b170043-d93e-4f8e-9f6a-90ee1dfd9595 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:52.983568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b170043-d93e-4f8e-9f6a-90ee1dfd9595 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:52.983568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b170043-d93e-4f8e-9f6a-90ee1dfd9595 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:52.984820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 679/1354] 10.222.0.23 () {54 vars in 921 bytes} [Tue Jun 28 03:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:52.990073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ff6ba-14bf-4907-b2b7-2cc21009c46f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:52.990543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ff6ba-14bf-4907-b2b7-2cc21009c46f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:52.990679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ff6ba-14bf-4907-b2b7-2cc21009c46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:53.010433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-ee9ff6ba-14bf-4907-b2b7-2cc21009c46f None None] MFA Rules not processed for user `28b8048235c6421eae12ca99f80ed5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:53.011641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ee9ff6ba-14bf-4907-b2b7-2cc21009c46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:53.021028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 676/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Jun 28 03:09:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:56.705393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d9d1c-1ff6-4d00-81ff-cfa1707bc1ac None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:56.705977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d9d1c-1ff6-4d00-81ff-cfa1707bc1ac None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:56.705977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d9d1c-1ff6-4d00-81ff-cfa1707bc1ac None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:56.712926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 680/1356] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:56.714890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171685f-46a7-4017-92a1-e8fef4a12a33 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:56.715894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171685f-46a7-4017-92a1-e8fef4a12a33 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:56.716366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171685f-46a7-4017-92a1-e8fef4a12a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:56.742351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7171685f-46a7-4017-92a1-e8fef4a12a33 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:56.743888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7171685f-46a7-4017-92a1-e8fef4a12a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:56.758706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 677/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:09:56.816984 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94b5a-58fe-40cf-bec3-f4f4d46de5fb None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:56.817622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94b5a-58fe-40cf-bec3-f4f4d46de5fb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:56.818103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94b5a-58fe-40cf-bec3-f4f4d46de5fb None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:56.819911 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 681/1358] 10.222.0.23 () {54 vars in 961 bytes} [Tue Jun 28 03:09:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:56.829351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725ec94-8d8b-4362-9cb4-0b31fb1aaeca None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:56.830080 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725ec94-8d8b-4362-9cb4-0b31fb1aaeca None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:56.830754 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725ec94-8d8b-4362-9cb4-0b31fb1aaeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:56.881005 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:09:56.889681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-9725ec94-8d8b-4362-9cb4-0b31fb1aaeca None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:56.890979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9725ec94-8d8b-4362-9cb4-0b31fb1aaeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:56.983256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 678/1359] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Jun 28 03:09:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:56.991021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94b5a-58fe-40cf-bec3-f4f4d46de5fb None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:57.006518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94b5a-58fe-40cf-bec3-f4f4d46de5fb None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:57.012225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2332466-790f-4f92-833b-93048915edcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:57.013017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332466-790f-4f92-833b-93048915edcf service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:57.013400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332466-790f-4f92-833b-93048915edcf service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:57.013774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332466-790f-4f92-833b-93048915edcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:57.023477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2332466-790f-4f92-833b-93048915edcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:57.025524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2332466-790f-4f92-833b-93048915edcf service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:57.036925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 682/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:09:59.257791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012c278-d499-40a3-8e10-b1075c0a101c None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:59.258583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012c278-d499-40a3-8e10-b1075c0a101c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:59.258583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012c278-d499-40a3-8e10-b1075c0a101c None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:59.259901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 679/1361] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:09:59.265351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a269095-9db3-4638-8051-ca574831c1e4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:59.267356 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a269095-9db3-4638-8051-ca574831c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:59.268064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a269095-9db3-4638-8051-ca574831c1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:59.288960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9a269095-9db3-4638-8051-ca574831c1e4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:09:59.290282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9a269095-9db3-4638-8051-ca574831c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:09:59.300412 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 683/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:09:59.345385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012c278-d499-40a3-8e10-b1075c0a101c None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:09:59.360786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012c278-d499-40a3-8e10-b1075c0a101c None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:09:59.366246 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592e203-480a-414e-a4ea-1f832d1e2437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:09:59.366919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592e203-480a-414e-a4ea-1f832d1e2437 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:09:59.367194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592e203-480a-414e-a4ea-1f832d1e2437 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:09:59.367468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592e203-480a-414e-a4ea-1f832d1e2437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:09:59.376025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592e203-480a-414e-a4ea-1f832d1e2437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:09:59.377616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592e203-480a-414e-a4ea-1f832d1e2437 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:09:59.388411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 680/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:01.742766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a298f-4965-4343-b852-0d53baf15e3f None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:01.743239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a298f-4965-4343-b852-0d53baf15e3f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:01.743365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a298f-4965-4343-b852-0d53baf15e3f None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:01.744652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 684/1364] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:01.750473 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e7d05-eac9-4371-820e-f169148b61af None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:01.750930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e7d05-eac9-4371-820e-f169148b61af None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:01.751170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e7d05-eac9-4371-820e-f169148b61af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:01.771060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-9b0e7d05-eac9-4371-820e-f169148b61af None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:01.772277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9b0e7d05-eac9-4371-820e-f169148b61af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:01.781543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 681/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:10:01.831972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b0a1d-c81e-46ae-a138-090a5c12bd6c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:01.832199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b0a1d-c81e-46ae-a138-090a5c12bd6c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:01.832970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b0a1d-c81e-46ae-a138-090a5c12bd6c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:01.849262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 685/1366] 10.222.0.23 () {54 vars in 961 bytes} [Tue Jun 28 03:10:01 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:01.862811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09217700-c1c5-46f1-a3d4-6ef26969a04c None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:01.863874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09217700-c1c5-46f1-a3d4-6ef26969a04c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:01.864307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09217700-c1c5-46f1-a3d4-6ef26969a04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:01.894249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-09217700-c1c5-46f1-a3d4-6ef26969a04c None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:01.895568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-09217700-c1c5-46f1-a3d4-6ef26969a04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:01.905630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 682/1367] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Jun 28 03:10:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:01.913637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b0a1d-c81e-46ae-a138-090a5c12bd6c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:01.929387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b0a1d-c81e-46ae-a138-090a5c12bd6c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:01.935143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517d4eb-dddc-4362-912a-9bdc91c12317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:01.935777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517d4eb-dddc-4362-912a-9bdc91c12317 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:01.936050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517d4eb-dddc-4362-912a-9bdc91c12317 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:01.936313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517d4eb-dddc-4362-912a-9bdc91c12317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:01.944342 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517d4eb-dddc-4362-912a-9bdc91c12317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:01.945915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517d4eb-dddc-4362-912a-9bdc91c12317 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:01.955435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 686/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:04.033798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941651c-4d16-463a-bb31-25fa2e626aeb None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:04.034400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941651c-4d16-463a-bb31-25fa2e626aeb None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:04.034400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941651c-4d16-463a-bb31-25fa2e626aeb None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:04.035735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 683/1369] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:04.041187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5327ce-47fa-4230-948b-622d56e4e7dd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:04.041629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5327ce-47fa-4230-948b-622d56e4e7dd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:04.041713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5327ce-47fa-4230-948b-622d56e4e7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:04.063238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ea5327ce-47fa-4230-948b-622d56e4e7dd None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:04.064718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ea5327ce-47fa-4230-948b-622d56e4e7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:04.074556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 687/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:04.118852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941651c-4d16-463a-bb31-25fa2e626aeb None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:04.134560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941651c-4d16-463a-bb31-25fa2e626aeb None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:04.140450 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b253a15-3913-4fe6-b809-058b56bd75dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:04.141228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b253a15-3913-4fe6-b809-058b56bd75dd service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:04.141607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b253a15-3913-4fe6-b809-058b56bd75dd service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:04.141976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b253a15-3913-4fe6-b809-058b56bd75dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:04.151898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b253a15-3913-4fe6-b809-058b56bd75dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:04.154051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b253a15-3913-4fe6-b809-058b56bd75dd service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:04.165721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 684/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:10:04.855698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034254e-afb1-4a39-9822-a60ae17cffd6 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:04.856387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034254e-afb1-4a39-9822-a60ae17cffd6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:04.857030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034254e-afb1-4a39-9822-a60ae17cffd6 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:04.858695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 688/1372] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:04.864307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274efe68-0713-43c7-a7d2-d29cb87841de None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:04.864860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274efe68-0713-43c7-a7d2-d29cb87841de None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:04.865377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274efe68-0713-43c7-a7d2-d29cb87841de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:04.884531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-274efe68-0713-43c7-a7d2-d29cb87841de None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:04.886043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-274efe68-0713-43c7-a7d2-d29cb87841de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:04.895183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 685/1373] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:05.198774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63a407-3711-47d9-baac-c82c6204a78b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:05.199241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63a407-3711-47d9-baac-c82c6204a78b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:05.199346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63a407-3711-47d9-baac-c82c6204a78b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:05.201474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 689/1374] 10.222.0.23 () {54 vars in 963 bytes} [Tue Jun 28 03:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:05.206640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c17065-67d1-4d57-9de8-246ef4f4801c None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:05.207107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c17065-67d1-4d57-9de8-246ef4f4801c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:05.207190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c17065-67d1-4d57-9de8-246ef4f4801c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:05.259480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-55c17065-67d1-4d57-9de8-246ef4f4801c None None] MFA Rules not processed for user `0f8a5bc11b6745a196337b4dc48de14e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:05.261020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-55c17065-67d1-4d57-9de8-246ef4f4801c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:05.335677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 686/1375] 10.222.0.23 () {58 vars in 1060 bytes} [Tue Jun 28 03:10:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:05.343561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63a407-3711-47d9-baac-c82c6204a78b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:05.354415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63a407-3711-47d9-baac-c82c6204a78b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:05.358656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb144bc-2615-4819-98c9-9e17516c4612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:05.359366 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb144bc-2615-4819-98c9-9e17516c4612 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:05.359639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb144bc-2615-4819-98c9-9e17516c4612 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:05.359910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb144bc-2615-4819-98c9-9e17516c4612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:05.369517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb144bc-2615-4819-98c9-9e17516c4612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:05.371098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb144bc-2615-4819-98c9-9e17516c4612 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:05.382502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 690/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:06.211572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21b2e-aeee-415b-a9f8-8018f363e614 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:06.212035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21b2e-aeee-415b-a9f8-8018f363e614 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:06.212459 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21b2e-aeee-415b-a9f8-8018f363e614 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:06.213663 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 687/1377] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:06.218770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b4e1-8b4c-42c4-b350-63343a8769f0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:06.219369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b4e1-8b4c-42c4-b350-63343a8769f0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:06.219369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b4e1-8b4c-42c4-b350-63343a8769f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:06.238377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-19d6b4e1-8b4c-42c4-b350-63343a8769f0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:06.239570 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-19d6b4e1-8b4c-42c4-b350-63343a8769f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:06.258963 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 691/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:06.293043 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f21b2e-aeee-415b-a9f8-8018f363e614 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:06.306769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f21b2e-aeee-415b-a9f8-8018f363e614 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:06.313015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ec5c4-c0e2-41f4-aeb9-8f558b3dbda4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:06.313715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ec5c4-c0e2-41f4-aeb9-8f558b3dbda4 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:06.313871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ec5c4-c0e2-41f4-aeb9-8f558b3dbda4 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:06.314238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ec5c4-c0e2-41f4-aeb9-8f558b3dbda4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:06.323184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ec5c4-c0e2-41f4-aeb9-8f558b3dbda4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:06.324845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ec5c4-c0e2-41f4-aeb9-8f558b3dbda4 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:06.329288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:06.347191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 688/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:08.387346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba062-aeb5-4793-9570-ece53284cc83 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:08.388257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba062-aeb5-4793-9570-ece53284cc83 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:08.388770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba062-aeb5-4793-9570-ece53284cc83 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:08.390567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 692/1380] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:08.396451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab70d-0ceb-4f6c-b392-af3c0274796f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:08.396962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab70d-0ceb-4f6c-b392-af3c0274796f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:08.397058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab70d-0ceb-4f6c-b392-af3c0274796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:08.415689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e61ab70d-0ceb-4f6c-b392-af3c0274796f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:08.416941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e61ab70d-0ceb-4f6c-b392-af3c0274796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:08.426992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 689/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:10:08.479718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ba062-aeb5-4793-9570-ece53284cc83 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:08.495250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ba062-aeb5-4793-9570-ece53284cc83 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:08.500627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8da462-a175-49fc-bcc6-180af43c6589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:08.501279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da462-a175-49fc-bcc6-180af43c6589 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:08.501559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da462-a175-49fc-bcc6-180af43c6589 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:08.501831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da462-a175-49fc-bcc6-180af43c6589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:08.510168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8da462-a175-49fc-bcc6-180af43c6589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:08.511798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8da462-a175-49fc-bcc6-180af43c6589 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:08.521229 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 693/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:10.591359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1166b-21bf-4868-9bbd-34731eab38a2 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:10.591780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1166b-21bf-4868-9bbd-34731eab38a2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:10.592111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1166b-21bf-4868-9bbd-34731eab38a2 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:10.593641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 690/1383] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:10.599124 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c544bc-9dad-42e0-9393-67a27a77c396 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:10.599537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c544bc-9dad-42e0-9393-67a27a77c396 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:10.599672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c544bc-9dad-42e0-9393-67a27a77c396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:10.619524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b2c544bc-9dad-42e0-9393-67a27a77c396 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:10.620724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b2c544bc-9dad-42e0-9393-67a27a77c396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:10.630478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 694/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:10.672748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1166b-21bf-4868-9bbd-34731eab38a2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:10.688621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1166b-21bf-4868-9bbd-34731eab38a2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:10.694727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a841d2e-77fd-4dca-9b9f-afa5b83e5625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:10.695582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a841d2e-77fd-4dca-9b9f-afa5b83e5625 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:10.695956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a841d2e-77fd-4dca-9b9f-afa5b83e5625 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:10.696325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a841d2e-77fd-4dca-9b9f-afa5b83e5625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:10.705537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a841d2e-77fd-4dca-9b9f-afa5b83e5625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:10.707321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a841d2e-77fd-4dca-9b9f-afa5b83e5625 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:10.717729 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 691/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:12.755048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f862-9ad0-4628-a83e-ed3fb6c64ace None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:12.755751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f862-9ad0-4628-a83e-ed3fb6c64ace None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:12.755751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f862-9ad0-4628-a83e-ed3fb6c64ace None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:12.757211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 695/1386] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:12.763895 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30d15-e198-471c-9234-5b5b280e8bd0 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:12.763895 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30d15-e198-471c-9234-5b5b280e8bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:12.764547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30d15-e198-471c-9234-5b5b280e8bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:12.792565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f6b30d15-e198-471c-9234-5b5b280e8bd0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:12.794410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f6b30d15-e198-471c-9234-5b5b280e8bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:12.808332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 692/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:12.853205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117f862-9ad0-4628-a83e-ed3fb6c64ace None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:12.869792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117f862-9ad0-4628-a83e-ed3fb6c64ace None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:12.877017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734865a9-a00e-4f3e-a0c1-d0554189a74f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:12.877873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734865a9-a00e-4f3e-a0c1-d0554189a74f service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:12.878137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734865a9-a00e-4f3e-a0c1-d0554189a74f service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:12.878444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734865a9-a00e-4f3e-a0c1-d0554189a74f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:12.889329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734865a9-a00e-4f3e-a0c1-d0554189a74f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:12.891025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734865a9-a00e-4f3e-a0c1-d0554189a74f service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:12.901557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 696/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:15.003955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c236-687d-4b36-a810-b71908d8c71f None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:15.004781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c236-687d-4b36-a810-b71908d8c71f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:15.004781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c236-687d-4b36-a810-b71908d8c71f None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:15.005957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 693/1389] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:15.012619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b4b7c-54b0-4888-896b-ae5ead9a49ca None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:15.013070 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b4b7c-54b0-4888-896b-ae5ead9a49ca None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:15.013181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b4b7c-54b0-4888-896b-ae5ead9a49ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:15.034209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3d6b4b7c-54b0-4888-896b-ae5ead9a49ca None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:15.035486 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3d6b4b7c-54b0-4888-896b-ae5ead9a49ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:15.044042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 697/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:15.095398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c236-687d-4b36-a810-b71908d8c71f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:15.111345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c236-687d-4b36-a810-b71908d8c71f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:15.117688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b1e76-78a1-402e-af5b-360bcb96c119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:15.118376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b1e76-78a1-402e-af5b-360bcb96c119 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:15.118637 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b1e76-78a1-402e-af5b-360bcb96c119 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:15.118901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b1e76-78a1-402e-af5b-360bcb96c119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:15.129300 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b1e76-78a1-402e-af5b-360bcb96c119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:15.130933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b1e76-78a1-402e-af5b-360bcb96c119 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:15.141627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 694/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:17.824375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640204-bd73-49e3-8f01-744ae7d8f6e9 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:17.825129 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640204-bd73-49e3-8f01-744ae7d8f6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:17.825129 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640204-bd73-49e3-8f01-744ae7d8f6e9 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:17.827035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 698/1392] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:17.832958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310de165-c79f-4032-abcf-88e7df65c281 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:17.833577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310de165-c79f-4032-abcf-88e7df65c281 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:17.833577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310de165-c79f-4032-abcf-88e7df65c281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:17.854454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-310de165-c79f-4032-abcf-88e7df65c281 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:17.855822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-310de165-c79f-4032-abcf-88e7df65c281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:17.865842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 695/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:17.917202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e640204-bd73-49e3-8f01-744ae7d8f6e9 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:17.935537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e640204-bd73-49e3-8f01-744ae7d8f6e9 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:17.942891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed1d09-2ff8-45aa-bc9f-9ce34c9df93e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:17.943659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed1d09-2ff8-45aa-bc9f-9ce34c9df93e service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:17.943947 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed1d09-2ff8-45aa-bc9f-9ce34c9df93e service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:17.944228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed1d09-2ff8-45aa-bc9f-9ce34c9df93e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:17.954758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed1d09-2ff8-45aa-bc9f-9ce34c9df93e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:17.956639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed1d09-2ff8-45aa-bc9f-9ce34c9df93e service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:17.967875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 699/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:10:20.025679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c1a1-e6b5-474c-bbe2-db6fbdb47f79 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:20.026340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c1a1-e6b5-474c-bbe2-db6fbdb47f79 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:20.026340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c1a1-e6b5-474c-bbe2-db6fbdb47f79 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:20.027792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 696/1395] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:20.033249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6db74e-6c85-4969-8242-2ae64a04edec None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:20.033761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6db74e-6c85-4969-8242-2ae64a04edec None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:20.033761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6db74e-6c85-4969-8242-2ae64a04edec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:20.052351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ef6db74e-6c85-4969-8242-2ae64a04edec None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:20.053572 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ef6db74e-6c85-4969-8242-2ae64a04edec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:20.062565 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 700/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:20.107870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1c1a1-e6b5-474c-bbe2-db6fbdb47f79 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:20.124315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1c1a1-e6b5-474c-bbe2-db6fbdb47f79 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:20.130242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df786dcf-b966-475d-9cef-3c7ed2cb278f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:20.130924 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df786dcf-b966-475d-9cef-3c7ed2cb278f service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:20.131207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df786dcf-b966-475d-9cef-3c7ed2cb278f service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:20.131482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df786dcf-b966-475d-9cef-3c7ed2cb278f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:20.141000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df786dcf-b966-475d-9cef-3c7ed2cb278f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:20.143007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df786dcf-b966-475d-9cef-3c7ed2cb278f service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:20.153245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 697/1397] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:20.483164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb168-840f-4bc6-857d-de2dd6bcb7e1 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:20.483593 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb168-840f-4bc6-857d-de2dd6bcb7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:20.483722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb168-840f-4bc6-857d-de2dd6bcb7e1 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:20.485102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 701/1398] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:20.490753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba9eb5-af8b-428e-ac4c-7ff12aa6a9bf None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:20.491034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba9eb5-af8b-428e-ac4c-7ff12aa6a9bf None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:20.491300 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba9eb5-af8b-428e-ac4c-7ff12aa6a9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:20.514669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-18ba9eb5-af8b-428e-ac4c-7ff12aa6a9bf None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:20.515880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-18ba9eb5-af8b-428e-ac4c-7ff12aa6a9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:20.525130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 698/1399] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:10:20.582783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7379106-0b04-494a-93bf-64e18df70e27 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:20.583052 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7379106-0b04-494a-93bf-64e18df70e27 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:20.583329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7379106-0b04-494a-93bf-64e18df70e27 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:20.584741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 702/1400] 10.222.0.23 () {54 vars in 962 bytes} [Tue Jun 28 03:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:20.590015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9442-063d-4cda-9146-12d29dd94504 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:20.590517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9442-063d-4cda-9146-12d29dd94504 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:20.591112 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9442-063d-4cda-9146-12d29dd94504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:20.644174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-555f9442-063d-4cda-9146-12d29dd94504 None None] MFA Rules not processed for user `70604923ae0b4a4dae21de1314cddbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:20.645364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-555f9442-063d-4cda-9146-12d29dd94504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:20.707675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 699/1401] 10.222.0.23 () {58 vars in 1059 bytes} [Tue Jun 28 03:10:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:20.715535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7379106-0b04-494a-93bf-64e18df70e27 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:20.727583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7379106-0b04-494a-93bf-64e18df70e27 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:20.732336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683da9d-b56b-44fa-8626-3876ffe29a91 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70604923ae0b4a4dae21de1314cddbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:20.732902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683da9d-b56b-44fa-8626-3876ffe29a91 service glance] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:20.733274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683da9d-b56b-44fa-8626-3876ffe29a91 service glance] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:20.733463 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683da9d-b56b-44fa-8626-3876ffe29a91 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:20.743976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683da9d-b56b-44fa-8626-3876ffe29a91 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:20.745487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683da9d-b56b-44fa-8626-3876ffe29a91 service glance] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:20.755868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 703/1402] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:21.478931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df32f2-f080-4051-805d-c1ad373ff959 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:21.479435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df32f2-f080-4051-805d-c1ad373ff959 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:21.479541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df32f2-f080-4051-805d-c1ad373ff959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:21.528071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-a6df32f2-f080-4051-805d-c1ad373ff959 None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:21.529120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a6df32f2-f080-4051-805d-c1ad373ff959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:21.577129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:21.609390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 700/1403] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:10:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:21.653106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdacf6-3164-44ca-afab-1936d17ebb3f None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:21.653642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdacf6-3164-44ca-afab-1936d17ebb3f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:21.653738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdacf6-3164-44ca-afab-1936d17ebb3f None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:21.655277 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 704/1404] 10.222.0.23 () {54 vars in 942 bytes} [Tue Jun 28 03:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:21.661769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5539e73-c985-4f5e-9326-8a6ff39977ef None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:21.662060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5539e73-c985-4f5e-9326-8a6ff39977ef None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:21.662359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5539e73-c985-4f5e-9326-8a6ff39977ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:21.713343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f5539e73-c985-4f5e-9326-8a6ff39977ef None None] MFA Rules not processed for user `9a40d290f0e147b9b62cf3eedf399e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:21.714576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f5539e73-c985-4f5e-9326-8a6ff39977ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:21.792389 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 701/1405] 10.222.0.23 () {58 vars in 1039 bytes} [Tue Jun 28 03:10:21 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:21.801749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdacf6-3164-44ca-afab-1936d17ebb3f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:21.816014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdacf6-3164-44ca-afab-1936d17ebb3f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:21.821206 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49ef87-1e5e-4ce1-84c8-f6cfda5b88c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:21.821954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ef87-1e5e-4ce1-84c8-f6cfda5b88c0 service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:21.822232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ef87-1e5e-4ce1-84c8-f6cfda5b88c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:21.822552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ef87-1e5e-4ce1-84c8-f6cfda5b88c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:21.830970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49ef87-1e5e-4ce1-84c8-f6cfda5b88c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:21.832556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49ef87-1e5e-4ce1-84c8-f6cfda5b88c0 service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:21.840812 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 705/1406] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:10:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:10:22.214051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5cedb-1a04-4ac1-92f1-50a566e9f460 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:22.214249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5cedb-1a04-4ac1-92f1-50a566e9f460 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:22.214557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5cedb-1a04-4ac1-92f1-50a566e9f460 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:22.216203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 702/1407] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:22.221656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1f37-8f0c-46e7-b662-256085df2889 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:22.221943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1f37-8f0c-46e7-b662-256085df2889 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:22.222207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1f37-8f0c-46e7-b662-256085df2889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:22.228486 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=67 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:22.244582 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d0ca1f37-8f0c-46e7-b662-256085df2889 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:22.245802 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d0ca1f37-8f0c-46e7-b662-256085df2889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:22.254133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 706/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:10:22.298943 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5cedb-1a04-4ac1-92f1-50a566e9f460 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:22.322319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5cedb-1a04-4ac1-92f1-50a566e9f460 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:22.328432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf7997-3b65-40ba-99cd-cf15e80910a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:22.329085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf7997-3b65-40ba-99cd-cf15e80910a6 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:22.329364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf7997-3b65-40ba-99cd-cf15e80910a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:22.329620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf7997-3b65-40ba-99cd-cf15e80910a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:22.337921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf7997-3b65-40ba-99cd-cf15e80910a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:22.339561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf7997-3b65-40ba-99cd-cf15e80910a6 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:22.350474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 703/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:32.239147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:32.346416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=59 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:44.355487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32240c05-702e-45f1-818e-620d38e0c670 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:44.356433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32240c05-702e-45f1-818e-620d38e0c670 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:44.356433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32240c05-702e-45f1-818e-620d38e0c670 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:44.358009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 707/1410] 10.222.0.23 () {54 vars in 918 bytes} [Tue Jun 28 03:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:44.363257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bee35-2bb0-4e06-a0aa-8de5ff32aa14 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:44.363701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bee35-2bb0-4e06-a0aa-8de5ff32aa14 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:44.363801 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bee35-2bb0-4e06-a0aa-8de5ff32aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:44.383103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-a91bee35-2bb0-4e06-a0aa-8de5ff32aa14 None None] MFA Rules not processed for user `28b8048235c6421eae12ca99f80ed5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:44.384306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a91bee35-2bb0-4e06-a0aa-8de5ff32aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:44.394470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 704/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Jun 28 03:10:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:44.409431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45051df-aa81-4d2b-97e6-0df3b782564c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:44.409710 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45051df-aa81-4d2b-97e6-0df3b782564c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:44.409979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45051df-aa81-4d2b-97e6-0df3b782564c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:44.411383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 708/1412] 10.222.0.23 () {54 vars in 918 bytes} [Tue Jun 28 03:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:44.416129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50051c-326d-4dc4-b77c-5a89c3b2168e None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:44.416415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50051c-326d-4dc4-b77c-5a89c3b2168e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:44.416682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50051c-326d-4dc4-b77c-5a89c3b2168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:44.434972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-0c50051c-326d-4dc4-b77c-5a89c3b2168e None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:44.436175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-0c50051c-326d-4dc4-b77c-5a89c3b2168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:44.445938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 705/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Jun 28 03:10:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:46.986798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6167769-1879-451f-95f5-40f64298b6c1 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:46.987630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6167769-1879-451f-95f5-40f64298b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:46.987783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6167769-1879-451f-95f5-40f64298b6c1 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:46.989962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:10:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:46.998862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ca744-dbe2-4a6c-bf1e-581f9a13e128 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:46.999319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ca744-dbe2-4a6c-bf1e-581f9a13e128 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:46.999432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ca744-dbe2-4a6c-bf1e-581f9a13e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:47.018485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-cd0ca744-dbe2-4a6c-bf1e-581f9a13e128 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:47.019600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cd0ca744-dbe2-4a6c-bf1e-581f9a13e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:47.028085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:47.079581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6167769-1879-451f-95f5-40f64298b6c1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:47.096301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6167769-1879-451f-95f5-40f64298b6c1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:47.102048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62064f-618c-48b0-87f4-1c4a96ca41a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:47.102747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62064f-618c-48b0-87f4-1c4a96ca41a8 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:47.103031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62064f-618c-48b0-87f4-1c4a96ca41a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:47.103310 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62064f-618c-48b0-87f4-1c4a96ca41a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:47.112548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62064f-618c-48b0-87f4-1c4a96ca41a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:47.114207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62064f-618c-48b0-87f4-1c4a96ca41a8 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:47.124414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 710/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:48.029040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404fa17-d695-4a2d-85bf-6d8c661a7af7 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:48.030372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404fa17-d695-4a2d-85bf-6d8c661a7af7 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:48.030711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404fa17-d695-4a2d-85bf-6d8c661a7af7 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:48.033249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:10:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:48.041509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b065b2-df2d-4bdd-b449-3e18ac302e82 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:48.041943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b065b2-df2d-4bdd-b449-3e18ac302e82 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:48.042340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b065b2-df2d-4bdd-b449-3e18ac302e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:48.063270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-72b065b2-df2d-4bdd-b449-3e18ac302e82 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:48.064486 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-72b065b2-df2d-4bdd-b449-3e18ac302e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:48.074619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:48.228258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404fa17-d695-4a2d-85bf-6d8c661a7af7 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:48.253527 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404fa17-d695-4a2d-85bf-6d8c661a7af7 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:48.263859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dce6a-a643-440a-8a8c-42eccc9fb97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:48.264503 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dce6a-a643-440a-8a8c-42eccc9fb97d service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:48.264787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dce6a-a643-440a-8a8c-42eccc9fb97d service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:48.265062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dce6a-a643-440a-8a8c-42eccc9fb97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:48.274041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dce6a-a643-440a-8a8c-42eccc9fb97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:48.275720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dce6a-a643-440a-8a8c-42eccc9fb97d service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:48.285484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 708/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:49.163423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f8a65-39d3-46e8-99c3-267ff669aed6 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:49.164321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f8a65-39d3-46e8-99c3-267ff669aed6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:49.164321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f8a65-39d3-46e8-99c3-267ff669aed6 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:49.166617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:10:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:49.172875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b290-a449-4a40-8ce1-39d966252f3d None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:49.173589 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b290-a449-4a40-8ce1-39d966252f3d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:49.173737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b290-a449-4a40-8ce1-39d966252f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:49.197623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e606b290-a449-4a40-8ce1-39d966252f3d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:49.198863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e606b290-a449-4a40-8ce1-39d966252f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:49.208921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:49.358621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f8a65-39d3-46e8-99c3-267ff669aed6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:49.380420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f8a65-39d3-46e8-99c3-267ff669aed6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:49.386585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecce738-281b-4010-8097-3f1b51bef435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:49.387228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecce738-281b-4010-8097-3f1b51bef435 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:49.387507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecce738-281b-4010-8097-3f1b51bef435 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:49.387781 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecce738-281b-4010-8097-3f1b51bef435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:49.396515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecce738-281b-4010-8097-3f1b51bef435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:49.398126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecce738-281b-4010-8097-3f1b51bef435 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:49.408234 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 713/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:50.288292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d584e72-3f51-44fe-9896-2639c79e74d3 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:50.289165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d584e72-3f51-44fe-9896-2639c79e74d3 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:50.289165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d584e72-3f51-44fe-9896-2639c79e74d3 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:50.291544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:10:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:50.297179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02332586-ea9a-49ea-bdb5-106270060df3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:50.297607 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02332586-ea9a-49ea-bdb5-106270060df3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:50.297719 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02332586-ea9a-49ea-bdb5-106270060df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:50.316684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-02332586-ea9a-49ea-bdb5-106270060df3 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:50.317844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-02332586-ea9a-49ea-bdb5-106270060df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:50.326755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:50.477403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d584e72-3f51-44fe-9896-2639c79e74d3 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:50.495479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d584e72-3f51-44fe-9896-2639c79e74d3 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:50.502159 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85ac10-f8b9-4d82-b8a6-35c3c9638844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:50.502834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85ac10-f8b9-4d82-b8a6-35c3c9638844 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:50.503118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85ac10-f8b9-4d82-b8a6-35c3c9638844 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:50.503388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85ac10-f8b9-4d82-b8a6-35c3c9638844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:50.511752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85ac10-f8b9-4d82-b8a6-35c3c9638844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:50.513417 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85ac10-f8b9-4d82-b8a6-35c3c9638844 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:50.523059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 711/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:51.413315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567faa2b-59ee-48f1-9765-619d0f4b4778 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:51.413898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567faa2b-59ee-48f1-9765-619d0f4b4778 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:51.413898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567faa2b-59ee-48f1-9765-619d0f4b4778 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:51.415443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:51.421403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40001476-9f30-4c2b-bc7e-62726b82a45b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:51.421859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40001476-9f30-4c2b-bc7e-62726b82a45b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:51.421953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40001476-9f30-4c2b-bc7e-62726b82a45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:51.445193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-40001476-9f30-4c2b-bc7e-62726b82a45b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:51.446443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-40001476-9f30-4c2b-bc7e-62726b82a45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:51.455400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:51.607935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567faa2b-59ee-48f1-9765-619d0f4b4778 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:51.624727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567faa2b-59ee-48f1-9765-619d0f4b4778 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:51.632374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea639123-cadb-4e49-b0a6-f2046ed89def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:51.633054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea639123-cadb-4e49-b0a6-f2046ed89def service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:51.633330 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea639123-cadb-4e49-b0a6-f2046ed89def service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:51.633600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea639123-cadb-4e49-b0a6-f2046ed89def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:51.643404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea639123-cadb-4e49-b0a6-f2046ed89def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:51.645013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea639123-cadb-4e49-b0a6-f2046ed89def service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:51.655425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 716/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:52.501826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9061-2ea1-4c2b-aaa2-9fd269f0460b None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:52.502764 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9061-2ea1-4c2b-aaa2-9fd269f0460b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:52.502881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9061-2ea1-4c2b-aaa2-9fd269f0460b None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:52.505312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:10:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:52.510856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fb49-dd47-47d3-94c9-e9613a5d42eb None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:52.511288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fb49-dd47-47d3-94c9-e9613a5d42eb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:52.511380 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fb49-dd47-47d3-94c9-e9613a5d42eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:52.530605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8111fb49-dd47-47d3-94c9-e9613a5d42eb None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:52.532251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8111fb49-dd47-47d3-94c9-e9613a5d42eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:52.541316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:52.708656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f9061-2ea1-4c2b-aaa2-9fd269f0460b None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:52.728623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f9061-2ea1-4c2b-aaa2-9fd269f0460b None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:52.736597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334a9f-12f7-47fa-9e36-5d7c57b0180d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:52.737248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334a9f-12f7-47fa-9e36-5d7c57b0180d service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:52.737522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334a9f-12f7-47fa-9e36-5d7c57b0180d service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:52.737789 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334a9f-12f7-47fa-9e36-5d7c57b0180d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:52.746608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b334a9f-12f7-47fa-9e36-5d7c57b0180d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:52.748866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b334a9f-12f7-47fa-9e36-5d7c57b0180d service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:52.760671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 714/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:53.579766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988c00-1e8f-49c8-bcd1-2664fa5238de None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:53.580399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988c00-1e8f-49c8-bcd1-2664fa5238de None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:53.580399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988c00-1e8f-49c8-bcd1-2664fa5238de None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:53.581678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:53.586931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b225a-5215-4888-87b2-8a487de4aebc None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:53.587386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b225a-5215-4888-87b2-8a487de4aebc None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:53.587500 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b225a-5215-4888-87b2-8a487de4aebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:53.607288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f23b225a-5215-4888-87b2-8a487de4aebc None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:53.608479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f23b225a-5215-4888-87b2-8a487de4aebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:53.618235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:53.770478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b988c00-1e8f-49c8-bcd1-2664fa5238de None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:53.791449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b988c00-1e8f-49c8-bcd1-2664fa5238de None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:53.800857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964642aa-2091-46bf-9e24-1710183047c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:53.801800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964642aa-2091-46bf-9e24-1710183047c2 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:53.802181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964642aa-2091-46bf-9e24-1710183047c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:53.802568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964642aa-2091-46bf-9e24-1710183047c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:53.814458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964642aa-2091-46bf-9e24-1710183047c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:53.816061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964642aa-2091-46bf-9e24-1710183047c2 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:53.826211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 719/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:54.620388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e41a8-8314-43f7-9e3c-4c10483ae252 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:54.620990 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e41a8-8314-43f7-9e3c-4c10483ae252 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:54.620990 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e41a8-8314-43f7-9e3c-4c10483ae252 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:54.624135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:10:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:54.632135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692302e7-9502-4306-8f08-719b077e70db None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:54.632861 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692302e7-9502-4306-8f08-719b077e70db None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:54.633048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692302e7-9502-4306-8f08-719b077e70db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:54.663308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-692302e7-9502-4306-8f08-719b077e70db None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:54.665148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-692302e7-9502-4306-8f08-719b077e70db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:54.679349 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:54.836380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e41a8-8314-43f7-9e3c-4c10483ae252 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:54.860737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e41a8-8314-43f7-9e3c-4c10483ae252 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:54.867001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b9b85-65b4-4204-801e-5126cbd5debd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:54.867655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b9b85-65b4-4204-801e-5126cbd5debd service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:54.867939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b9b85-65b4-4204-801e-5126cbd5debd service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:54.868214 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b9b85-65b4-4204-801e-5126cbd5debd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:54.876531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b9b85-65b4-4204-801e-5126cbd5debd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:54.878071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b9b85-65b4-4204-801e-5126cbd5debd service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:54.887750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 717/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:55.693769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da897bb-ada1-4127-8f3a-cd98ab55d58b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:55.694375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da897bb-ada1-4127-8f3a-cd98ab55d58b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:55.694375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da897bb-ada1-4127-8f3a-cd98ab55d58b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:55.695713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:55.701837 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdbae6-f477-46d1-adaf-3ffac90c9c63 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:55.702275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdbae6-f477-46d1-adaf-3ffac90c9c63 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:55.702413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdbae6-f477-46d1-adaf-3ffac90c9c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:55.731500 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-9bbdbae6-f477-46d1-adaf-3ffac90c9c63 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:55.733188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9bbdbae6-f477-46d1-adaf-3ffac90c9c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:55.742044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:55.894923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da897bb-ada1-4127-8f3a-cd98ab55d58b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:55.914396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da897bb-ada1-4127-8f3a-cd98ab55d58b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:55.920232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dc1ff-d076-41e4-aa76-f9a78de0655c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:55.920876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dc1ff-d076-41e4-aa76-f9a78de0655c service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:55.921157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dc1ff-d076-41e4-aa76-f9a78de0655c service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:55.921432 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dc1ff-d076-41e4-aa76-f9a78de0655c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:55.929784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dc1ff-d076-41e4-aa76-f9a78de0655c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:55.931456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dc1ff-d076-41e4-aa76-f9a78de0655c service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:55.941059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 722/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:10:57.863560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0bcee-1637-4469-8acb-b6d1b8bad2e0 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:57.864174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0bcee-1637-4469-8acb-b6d1b8bad2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:57.864174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0bcee-1637-4469-8acb-b6d1b8bad2e0 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:57.865475 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:10:57.872451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358f09-6c5e-429a-88f1-59b9730f569b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:57.873440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358f09-6c5e-429a-88f1-59b9730f569b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:57.873440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358f09-6c5e-429a-88f1-59b9730f569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:57.898994 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-13358f09-6c5e-429a-88f1-59b9730f569b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:10:57.900191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-13358f09-6c5e-429a-88f1-59b9730f569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:10:57.908642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:10:57.946750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0bcee-1637-4469-8acb-b6d1b8bad2e0 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:10:57.959716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0bcee-1637-4469-8acb-b6d1b8bad2e0 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:10:57.965386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb91c-9656-405a-8c44-728395c18ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:10:57.966444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb91c-9656-405a-8c44-728395c18ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:10:57.966886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb91c-9656-405a-8c44-728395c18ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:10:57.967474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb91c-9656-405a-8c44-728395c18ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:10:57.978672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddb91c-9656-405a-8c44-728395c18ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:10:57.980120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddb91c-9656-405a-8c44-728395c18ab9 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:10:57.991089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 720/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:00.223007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be787095-fc09-41b4-9540-d9874e8a88bd None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:00.223893 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be787095-fc09-41b4-9540-d9874e8a88bd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:00.223893 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be787095-fc09-41b4-9540-d9874e8a88bd None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:00.225981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:11:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:00.233231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b074-b19f-43b1-833f-23de5bbe1909 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:00.234018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b074-b19f-43b1-833f-23de5bbe1909 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:00.234180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b074-b19f-43b1-833f-23de5bbe1909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:00.254074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6792b074-b19f-43b1-833f-23de5bbe1909 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:00.255309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6792b074-b19f-43b1-833f-23de5bbe1909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:00.264905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:00.303652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be787095-fc09-41b4-9540-d9874e8a88bd None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:00.317393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be787095-fc09-41b4-9540-d9874e8a88bd None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:00.321628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a6bd-b40e-45f1-bfe0-7ff55c7533c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:00.322274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a6bd-b40e-45f1-bfe0-7ff55c7533c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:00.322581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a6bd-b40e-45f1-bfe0-7ff55c7533c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:00.322839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a6bd-b40e-45f1-bfe0-7ff55c7533c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:00.332679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a6bd-b40e-45f1-bfe0-7ff55c7533c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:00.334112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a6bd-b40e-45f1-bfe0-7ff55c7533c7 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:00.344448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 725/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:02.706806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3764e-2f7a-47dd-b902-fe11fb207238 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:02.707746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3764e-2f7a-47dd-b902-fe11fb207238 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:02.707746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3764e-2f7a-47dd-b902-fe11fb207238 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:02.709893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:11:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:02.717905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e26f9-0a93-4d7d-9a7a-cca3fc45fa96 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:02.718338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e26f9-0a93-4d7d-9a7a-cca3fc45fa96 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:02.718500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e26f9-0a93-4d7d-9a7a-cca3fc45fa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:02.739556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b10e26f9-0a93-4d7d-9a7a-cca3fc45fa96 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:02.740762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b10e26f9-0a93-4d7d-9a7a-cca3fc45fa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:02.749080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:02.792336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3764e-2f7a-47dd-b902-fe11fb207238 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:02.811101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3764e-2f7a-47dd-b902-fe11fb207238 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:02.815272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272e891-10a8-4bbc-9f1e-14fdf8e6bab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:02.815921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e891-10a8-4bbc-9f1e-14fdf8e6bab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:02.816205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e891-10a8-4bbc-9f1e-14fdf8e6bab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:02.816511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e891-10a8-4bbc-9f1e-14fdf8e6bab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:02.826933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272e891-10a8-4bbc-9f1e-14fdf8e6bab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:02.828377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272e891-10a8-4bbc-9f1e-14fdf8e6bab5 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:02.838488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 723/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:04.972974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368a8c8-70ea-412c-a5f8-6b4303c5188a None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:04.973444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368a8c8-70ea-412c-a5f8-6b4303c5188a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:04.973559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368a8c8-70ea-412c-a5f8-6b4303c5188a None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:04.975783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:11:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:04.985989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce8041-082e-4580-aca4-03d01e4c74e1 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:04.986586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce8041-082e-4580-aca4-03d01e4c74e1 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:04.986586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce8041-082e-4580-aca4-03d01e4c74e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:05.006769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e5ce8041-082e-4580-aca4-03d01e4c74e1 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:05.007901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e5ce8041-082e-4580-aca4-03d01e4c74e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:05.017541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:05.065759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368a8c8-70ea-412c-a5f8-6b4303c5188a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:05.080324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368a8c8-70ea-412c-a5f8-6b4303c5188a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:05.084982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cad012-1c69-4482-87d3-0177d5ec2824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:05.085684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cad012-1c69-4482-87d3-0177d5ec2824 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:05.085958 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cad012-1c69-4482-87d3-0177d5ec2824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:05.086369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cad012-1c69-4482-87d3-0177d5ec2824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:05.096787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cad012-1c69-4482-87d3-0177d5ec2824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:05.098238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cad012-1c69-4482-87d3-0177d5ec2824 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:05.109195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 728/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:07.231763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0075492-a6d1-44af-91e4-5a47af9543b0 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:07.232371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0075492-a6d1-44af-91e4-5a47af9543b0 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:07.232571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0075492-a6d1-44af-91e4-5a47af9543b0 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:07.234036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:11:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:07.242331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12307-1d23-4f3d-99ea-95b8e7391790 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:07.242734 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12307-1d23-4f3d-99ea-95b8e7391790 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:07.242870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12307-1d23-4f3d-99ea-95b8e7391790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:07.268170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-40e12307-1d23-4f3d-99ea-95b8e7391790 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:07.269393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-40e12307-1d23-4f3d-99ea-95b8e7391790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:07.278584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:07.317586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0075492-a6d1-44af-91e4-5a47af9543b0 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:07.332950 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0075492-a6d1-44af-91e4-5a47af9543b0 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:07.336913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d84ec-a644-439c-85ed-98de995b607a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:07.337565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d84ec-a644-439c-85ed-98de995b607a service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:07.337839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d84ec-a644-439c-85ed-98de995b607a service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:07.338117 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d84ec-a644-439c-85ed-98de995b607a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:07.347941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d84ec-a644-439c-85ed-98de995b607a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:07.349364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d84ec-a644-439c-85ed-98de995b607a service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:07.360053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 726/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:09.552510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e58de-4c1b-42f7-867f-480fb378e952 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:09.553083 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e58de-4c1b-42f7-867f-480fb378e952 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:09.553083 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e58de-4c1b-42f7-867f-480fb378e952 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:09.554504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:09.561025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30638f-dd6c-429e-922a-d711de41898b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:09.561736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30638f-dd6c-429e-922a-d711de41898b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:09.561897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30638f-dd6c-429e-922a-d711de41898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:09.586171 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-ed30638f-dd6c-429e-922a-d711de41898b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:09.587414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ed30638f-dd6c-429e-922a-d711de41898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:09.596647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:09.635393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e58de-4c1b-42f7-867f-480fb378e952 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:09.649145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e58de-4c1b-42f7-867f-480fb378e952 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:09.653176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbefb99-59ad-4caa-9a8f-264fe96c2edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:09.653923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbefb99-59ad-4caa-9a8f-264fe96c2edd service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:09.654387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbefb99-59ad-4caa-9a8f-264fe96c2edd service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:09.654678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbefb99-59ad-4caa-9a8f-264fe96c2edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:09.664483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbefb99-59ad-4caa-9a8f-264fe96c2edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:09.665929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbefb99-59ad-4caa-9a8f-264fe96c2edd service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:09.675814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 731/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:11.760195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa89f2-5a17-4631-aaf3-74c4ac9726a2 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:11.760785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa89f2-5a17-4631-aaf3-74c4ac9726a2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:11.760785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa89f2-5a17-4631-aaf3-74c4ac9726a2 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:11.762961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:11:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:11.771522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d85e-aace-4f6f-a007-8771e7afe549 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:11.771932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d85e-aace-4f6f-a007-8771e7afe549 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:11.772088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d85e-aace-4f6f-a007-8771e7afe549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:11.793510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c278d85e-aace-4f6f-a007-8771e7afe549 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:11.795003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c278d85e-aace-4f6f-a007-8771e7afe549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:11.807358 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:11.845137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa89f2-5a17-4631-aaf3-74c4ac9726a2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:11.857828 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa89f2-5a17-4631-aaf3-74c4ac9726a2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:11.862062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d9c4e-c28b-4f45-b3bb-5c0c3d053da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:11.862723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d9c4e-c28b-4f45-b3bb-5c0c3d053da7 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:11.862997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d9c4e-c28b-4f45-b3bb-5c0c3d053da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:11.863267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d9c4e-c28b-4f45-b3bb-5c0c3d053da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:11.883936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d9c4e-c28b-4f45-b3bb-5c0c3d053da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:11.885368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d9c4e-c28b-4f45-b3bb-5c0c3d053da7 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:11.899337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 729/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:11:13.984157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4796c-e2fc-4bd7-b0a5-382d88e1e7f3 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:13.984763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4796c-e2fc-4bd7-b0a5-382d88e1e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:13.984763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4796c-e2fc-4bd7-b0a5-382d88e1e7f3 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:13.986091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 03:11:13.992552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29cb77-2bc5-472f-bc72-0ffd051bfd62 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:13.993015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29cb77-2bc5-472f-bc72-0ffd051bfd62 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:13.993212 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29cb77-2bc5-472f-bc72-0ffd051bfd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:14.003759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=79 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:11:14.020367 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-9a29cb77-2bc5-472f-bc72-0ffd051bfd62 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:14.021577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9a29cb77-2bc5-472f-bc72-0ffd051bfd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:14.031079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:14.069664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4796c-e2fc-4bd7-b0a5-382d88e1e7f3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:14.075885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=73 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:11:14.085096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4796c-e2fc-4bd7-b0a5-382d88e1e7f3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:14.091736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489299f2-307f-42fa-931a-a7a2a18e4074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:14.092668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489299f2-307f-42fa-931a-a7a2a18e4074 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:14.093017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489299f2-307f-42fa-931a-a7a2a18e4074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:14.093293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489299f2-307f-42fa-931a-a7a2a18e4074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:14.108767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489299f2-307f-42fa-931a-a7a2a18e4074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:14.110219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489299f2-307f-42fa-931a-a7a2a18e4074 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:14.120341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 734/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:16.160977 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff377687-8904-4d05-964c-e08c5e894dac None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:16.161862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff377687-8904-4d05-964c-e08c5e894dac None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:16.161862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff377687-8904-4d05-964c-e08c5e894dac None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:16.164280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:11:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:16.172462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66e63-2ddf-4c6e-97a5-34060954e94e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:16.172884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66e63-2ddf-4c6e-97a5-34060954e94e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:16.172994 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66e63-2ddf-4c6e-97a5-34060954e94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:16.191165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f1b66e63-2ddf-4c6e-97a5-34060954e94e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:16.192358 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f1b66e63-2ddf-4c6e-97a5-34060954e94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:16.200724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:11:16.238761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff377687-8904-4d05-964c-e08c5e894dac None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:16.258018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff377687-8904-4d05-964c-e08c5e894dac None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:16.264761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b06d75-2335-49f2-bd8f-0751d75788eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:16.265475 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b06d75-2335-49f2-bd8f-0751d75788eb service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:16.265753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b06d75-2335-49f2-bd8f-0751d75788eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:16.266042 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b06d75-2335-49f2-bd8f-0751d75788eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:16.276344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b06d75-2335-49f2-bd8f-0751d75788eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:16.277789 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b06d75-2335-49f2-bd8f-0751d75788eb service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:16.288792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 732/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:18.334233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703c41-a363-48b0-964f-dbd56778a9b4 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:18.334863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703c41-a363-48b0-964f-dbd56778a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:18.334863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703c41-a363-48b0-964f-dbd56778a9b4 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:18.336152 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:18.342631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52840d-f144-4955-8677-02fca68b7797 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:18.343381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52840d-f144-4955-8677-02fca68b7797 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:18.343617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52840d-f144-4955-8677-02fca68b7797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:18.369446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-2b52840d-f144-4955-8677-02fca68b7797 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:18.370691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-2b52840d-f144-4955-8677-02fca68b7797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:18.381239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:18.419597 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0703c41-a363-48b0-964f-dbd56778a9b4 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:18.431748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0703c41-a363-48b0-964f-dbd56778a9b4 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:18.435889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cc809-8b39-4857-a3cb-b13e717763ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:18.436544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cc809-8b39-4857-a3cb-b13e717763ef service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:18.436825 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cc809-8b39-4857-a3cb-b13e717763ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:18.437254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cc809-8b39-4857-a3cb-b13e717763ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:18.446313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cc809-8b39-4857-a3cb-b13e717763ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:18.447764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cc809-8b39-4857-a3cb-b13e717763ef service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:18.457606 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 737/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:28.363859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=11 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:11:28.453048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=14 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:11:38.243474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85415593-a9db-4fd2-b29d-67c0d0e30156 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:38.244122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85415593-a9db-4fd2-b29d-67c0d0e30156 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:38.244122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85415593-a9db-4fd2-b29d-67c0d0e30156 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:38.245394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 734/1471] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:38.251344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fd3fd-3c33-470f-9d52-8ed0591ebc8c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:38.251818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fd3fd-3c33-470f-9d52-8ed0591ebc8c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:38.251934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fd3fd-3c33-470f-9d52-8ed0591ebc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:38.270344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4b2fd3fd-3c33-470f-9d52-8ed0591ebc8c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:38.271549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4b2fd3fd-3c33-470f-9d52-8ed0591ebc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:38.280131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 738/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:38.328089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f8bc1-9fcb-4a51-9ec9-4d59ec06cd80 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:38.328420 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f8bc1-9fcb-4a51-9ec9-4d59ec06cd80 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:38.328693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f8bc1-9fcb-4a51-9ec9-4d59ec06cd80 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:38.330073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 735/1473] 10.222.0.23 () {54 vars in 962 bytes} [Tue Jun 28 03:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:38.336972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077663a-ca7d-46c5-a4db-62a0265d0d4e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:38.337262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077663a-ca7d-46c5-a4db-62a0265d0d4e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:38.337560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077663a-ca7d-46c5-a4db-62a0265d0d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:38.357947 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3077663a-ca7d-46c5-a4db-62a0265d0d4e None None] MFA Rules not processed for user `70604923ae0b4a4dae21de1314cddbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:38.359186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3077663a-ca7d-46c5-a4db-62a0265d0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:38.366971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 739/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Tue Jun 28 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:38.374469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f8bc1-9fcb-4a51-9ec9-4d59ec06cd80 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:38.386930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f8bc1-9fcb-4a51-9ec9-4d59ec06cd80 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:38.391516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbf4cb-9b19-4935-a985-fd213b64c54b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70604923ae0b4a4dae21de1314cddbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:38.392002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbf4cb-9b19-4935-a985-fd213b64c54b service glance] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:38.392364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbf4cb-9b19-4935-a985-fd213b64c54b service glance] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:38.393030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbf4cb-9b19-4935-a985-fd213b64c54b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:38.404688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbf4cb-9b19-4935-a985-fd213b64c54b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:38.406238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbf4cb-9b19-4935-a985-fd213b64c54b service glance] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:38.416445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 736/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:40.554402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3015a-fe58-4653-89cf-6e5b223c0276 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:40.554973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3015a-fe58-4653-89cf-6e5b223c0276 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:40.554973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3015a-fe58-4653-89cf-6e5b223c0276 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:40.556310 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 740/1476] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:40.562646 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd00cb-c54d-480d-8974-1c115ebb734b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:40.563104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd00cb-c54d-480d-8974-1c115ebb734b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:40.563213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd00cb-c54d-480d-8974-1c115ebb734b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:40.581978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-dbbd00cb-c54d-480d-8974-1c115ebb734b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:40.583202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-dbbd00cb-c54d-480d-8974-1c115ebb734b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:40.591920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 737/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:40.615780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3015a-fe58-4653-89cf-6e5b223c0276 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:40.629699 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3015a-fe58-4653-89cf-6e5b223c0276 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:40.635144 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cafcf1-f55c-45e9-a8b7-ca24988d3027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:40.635797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cafcf1-f55c-45e9-a8b7-ca24988d3027 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:40.636073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cafcf1-f55c-45e9-a8b7-ca24988d3027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:40.636344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cafcf1-f55c-45e9-a8b7-ca24988d3027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:40.637081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cafcf1-f55c-45e9-a8b7-ca24988d3027 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:40.638862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: WARNING py.warnings [None req-50cafcf1-f55c-45e9-a8b7-ca24988d3027 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:11:40.638862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: warnings.warn(msg) Jun 28 03:11:40.638862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: Jun 28 03:11:40.640003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cafcf1-f55c-45e9-a8b7-ca24988d3027 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:40.660434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 741/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Jun 28 03:11:40 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:11:42.740033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b318-f39a-4660-942e-751880a4727b None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:42.740639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b318-f39a-4660-942e-751880a4727b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:42.740639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b318-f39a-4660-942e-751880a4727b None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:42.741962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 738/1479] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:42.748392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3acbe5-96f8-48de-b7fe-395fe2445928 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:42.749174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3acbe5-96f8-48de-b7fe-395fe2445928 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:42.749174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3acbe5-96f8-48de-b7fe-395fe2445928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:42.771623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4f3acbe5-96f8-48de-b7fe-395fe2445928 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:42.773458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4f3acbe5-96f8-48de-b7fe-395fe2445928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:42.784393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 742/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:42.835461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0b318-f39a-4660-942e-751880a4727b None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:42.853876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0b318-f39a-4660-942e-751880a4727b None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:42.860384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c657e6-7639-4a6e-bc76-7776c612093d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:42.861033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c657e6-7639-4a6e-bc76-7776c612093d service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:42.861316 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c657e6-7639-4a6e-bc76-7776c612093d service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:42.861592 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c657e6-7639-4a6e-bc76-7776c612093d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:42.869836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c657e6-7639-4a6e-bc76-7776c612093d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:42.871505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c657e6-7639-4a6e-bc76-7776c612093d service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:42.881477 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 739/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:45.069170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a117ddb-8556-4b1d-a311-6486dbdc399c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:45.069769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a117ddb-8556-4b1d-a311-6486dbdc399c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:45.069769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a117ddb-8556-4b1d-a311-6486dbdc399c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:45.071131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 743/1482] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:45.077775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d775c-f5a7-43a3-814e-e3ff5350cc5e None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:45.078511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d775c-f5a7-43a3-814e-e3ff5350cc5e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:45.078988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d775c-f5a7-43a3-814e-e3ff5350cc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:45.103224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-1e7d775c-f5a7-43a3-814e-e3ff5350cc5e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:45.104429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1e7d775c-f5a7-43a3-814e-e3ff5350cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:45.113737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 740/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:45.152760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a117ddb-8556-4b1d-a311-6486dbdc399c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:45.168711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a117ddb-8556-4b1d-a311-6486dbdc399c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:45.172831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a531700-4a3c-4068-944f-e90d53be8aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:45.173476 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a531700-4a3c-4068-944f-e90d53be8aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:45.173758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a531700-4a3c-4068-944f-e90d53be8aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:45.174025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a531700-4a3c-4068-944f-e90d53be8aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:45.183675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a531700-4a3c-4068-944f-e90d53be8aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:45.185110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a531700-4a3c-4068-944f-e90d53be8aa7 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:45.195279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 744/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:47.292698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cfc8f-7de6-45a1-81b6-de9ab71b109b None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:47.293267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cfc8f-7de6-45a1-81b6-de9ab71b109b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:47.293267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cfc8f-7de6-45a1-81b6-de9ab71b109b None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:47.294620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 741/1485] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:47.301073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fe8c0-528e-4bd7-86d0-4591adf0d389 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:47.301788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fe8c0-528e-4bd7-86d0-4591adf0d389 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:47.301969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fe8c0-528e-4bd7-86d0-4591adf0d389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:47.324591 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fa1fe8c0-528e-4bd7-86d0-4591adf0d389 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:47.325750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fa1fe8c0-528e-4bd7-86d0-4591adf0d389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:47.334960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 745/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:47.377689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cfc8f-7de6-45a1-81b6-de9ab71b109b None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:47.396355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cfc8f-7de6-45a1-81b6-de9ab71b109b None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:47.403322 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec272a19-c9ea-49b8-8fe9-0016e67636cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:47.404192 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272a19-c9ea-49b8-8fe9-0016e67636cc service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:47.404630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272a19-c9ea-49b8-8fe9-0016e67636cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:47.405061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272a19-c9ea-49b8-8fe9-0016e67636cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:47.415305 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec272a19-c9ea-49b8-8fe9-0016e67636cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:47.416793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec272a19-c9ea-49b8-8fe9-0016e67636cc service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:47.427003 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 742/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:49.582154 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d319e9d-0d47-4b8c-8e3e-cabe22e464f7 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:49.582801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d319e9d-0d47-4b8c-8e3e-cabe22e464f7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:49.582801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d319e9d-0d47-4b8c-8e3e-cabe22e464f7 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:49.584114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 746/1488] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:49.590576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cf6c6-716d-486c-9c0b-2c16b7f911ae None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:49.591338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cf6c6-716d-486c-9c0b-2c16b7f911ae None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:49.591463 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cf6c6-716d-486c-9c0b-2c16b7f911ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:49.612757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-a38cf6c6-716d-486c-9c0b-2c16b7f911ae None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:49.613947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a38cf6c6-716d-486c-9c0b-2c16b7f911ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:49.623780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 743/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:11:49.668235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d319e9d-0d47-4b8c-8e3e-cabe22e464f7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:49.685254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d319e9d-0d47-4b8c-8e3e-cabe22e464f7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:49.690705 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36c768-e7ab-4f74-ad94-e5201a4f4113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:49.691357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36c768-e7ab-4f74-ad94-e5201a4f4113 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:49.691625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36c768-e7ab-4f74-ad94-e5201a4f4113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:49.691883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36c768-e7ab-4f74-ad94-e5201a4f4113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:49.700999 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36c768-e7ab-4f74-ad94-e5201a4f4113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:49.702456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36c768-e7ab-4f74-ad94-e5201a4f4113 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:49.711867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 747/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:51.979044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796f414-8c83-44d0-88f5-cdfd9e5eda99 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:51.979965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796f414-8c83-44d0-88f5-cdfd9e5eda99 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:51.979965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796f414-8c83-44d0-88f5-cdfd9e5eda99 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:51.982549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 744/1491] 10.222.0.23 () {54 vars in 926 bytes} [Tue Jun 28 03:11:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:11:51.989711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29344360-c63c-4330-a851-701079ad99dd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:51.990186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29344360-c63c-4330-a851-701079ad99dd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:51.990387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29344360-c63c-4330-a851-701079ad99dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:52.008516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-29344360-c63c-4330-a851-701079ad99dd None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:11:52.009704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-29344360-c63c-4330-a851-701079ad99dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:11:52.018326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 748/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Jun 28 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:11:52.066155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796f414-8c83-44d0-88f5-cdfd9e5eda99 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:11:52.077736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796f414-8c83-44d0-88f5-cdfd9e5eda99 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:11:52.081805 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb17d3-3f24-41ee-84b4-584c672e13d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:11:52.082624 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb17d3-3f24-41ee-84b4-584c672e13d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:11:52.082757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb17d3-3f24-41ee-84b4-584c672e13d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:11:52.083030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb17d3-3f24-41ee-84b4-584c672e13d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:11:52.092723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb17d3-3f24-41ee-84b4-584c672e13d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:11:52.094202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb17d3-3f24-41ee-84b4-584c672e13d2 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:11:52.103960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 745/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:12:02.003401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=33 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:12:02.099875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=33 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:13:24.357503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bee89-57e9-4452-bbe6-8379f9f76cc2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:24.358413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bee89-57e9-4452-bbe6-8379f9f76cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:24.358413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bee89-57e9-4452-bbe6-8379f9f76cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:24.379775 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-be2bee89-57e9-4452-bbe6-8379f9f76cc2 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:13:24.381090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-be2bee89-57e9-4452-bbe6-8379f9f76cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:13:24.390265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 749/1494] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:13:24.398559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c5ab6-5e88-43d7-9b03-b70b195bd39d None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:24.399092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c5ab6-5e88-43d7-9b03-b70b195bd39d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:24.399092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c5ab6-5e88-43d7-9b03-b70b195bd39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:24.418177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-bd3c5ab6-5e88-43d7-9b03-b70b195bd39d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:13:24.419363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bd3c5ab6-5e88-43d7-9b03-b70b195bd39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:13:24.429255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 746/1495] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:13:24.433867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bee89-57e9-4452-bbe6-8379f9f76cc2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:13:24.444131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bee89-57e9-4452-bbe6-8379f9f76cc2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:13:24.449887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612e5bb-38b2-4bf1-a54e-6722a711df9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:13:24.450610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612e5bb-38b2-4bf1-a54e-6722a711df9a admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:24.450889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612e5bb-38b2-4bf1-a54e-6722a711df9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:24.451157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612e5bb-38b2-4bf1-a54e-6722a711df9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:24.451884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612e5bb-38b2-4bf1-a54e-6722a711df9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:13:24.452183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612e5bb-38b2-4bf1-a54e-6722a711df9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:13:24.453199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: WARNING py.warnings [None req-f612e5bb-38b2-4bf1-a54e-6722a711df9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:13:24.453199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: warnings.warn(msg) Jun 28 03:13:24.453199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: Jun 28 03:13:24.454075 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612e5bb-38b2-4bf1-a54e-6722a711df9a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:13:24.466285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 750/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:13:24.474888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c5ab6-5e88-43d7-9b03-b70b195bd39d None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:13:24.484813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c5ab6-5e88-43d7-9b03-b70b195bd39d None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:13:24.490719 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd555000-e2bc-402a-9529-bb609b830445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:13:24.491353 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd555000-e2bc-402a-9529-bb609b830445 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:24.491627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd555000-e2bc-402a-9529-bb609b830445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:24.491914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd555000-e2bc-402a-9529-bb609b830445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:24.492603 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd555000-e2bc-402a-9529-bb609b830445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:13:24.494433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: WARNING py.warnings [None req-bd555000-e2bc-402a-9529-bb609b830445 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:13:24.494433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: warnings.warn(msg) Jun 28 03:13:24.494433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: Jun 28 03:13:24.495661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd555000-e2bc-402a-9529-bb609b830445 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:13:24.541165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 747/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:13:24 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:13:24.546139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612e5bb-38b2-4bf1-a54e-6722a711df9a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:13:24.559148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612e5bb-38b2-4bf1-a54e-6722a711df9a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:13:24.620381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579693e-1a94-4176-a8ab-88558ff04b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:13:24.621047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579693e-1a94-4176-a8ab-88558ff04b99 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:24.621322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579693e-1a94-4176-a8ab-88558ff04b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:24.621590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579693e-1a94-4176-a8ab-88558ff04b99 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:24.622281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579693e-1a94-4176-a8ab-88558ff04b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:13:24.623352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: WARNING py.warnings [None req-0579693e-1a94-4176-a8ab-88558ff04b99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:13:24.623352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: warnings.warn(msg) Jun 28 03:13:24.623352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: Jun 28 03:13:24.624517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579693e-1a94-4176-a8ab-88558ff04b99 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:13:24.646664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 751/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:13:24 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:13:24.651060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd555000-e2bc-402a-9529-bb609b830445 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:13:24.661960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd555000-e2bc-402a-9529-bb609b830445 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:13:24.666735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8876a4-9f98-4be2-b94f-f3178d7310cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:13:24.667378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8876a4-9f98-4be2-b94f-f3178d7310cf admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:24.667661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8876a4-9f98-4be2-b94f-f3178d7310cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:24.667931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8876a4-9f98-4be2-b94f-f3178d7310cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:24.668668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8876a4-9f98-4be2-b94f-f3178d7310cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:13:24.669675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: WARNING py.warnings [None req-8f8876a4-9f98-4be2-b94f-f3178d7310cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:13:24.669675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: warnings.warn(msg) Jun 28 03:13:24.669675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: Jun 28 03:13:24.670597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8876a4-9f98-4be2-b94f-f3178d7310cf admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:13:24.683609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 748/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:13:24.687722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579693e-1a94-4176-a8ab-88558ff04b99 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:13:24.698177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579693e-1a94-4176-a8ab-88558ff04b99 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:13:24.703060 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad0bd1-9e52-4547-8548-6ca2e58e86a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:13:24.703734 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0bd1-9e52-4547-8548-6ca2e58e86a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:24.703998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0bd1-9e52-4547-8548-6ca2e58e86a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:24.704264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0bd1-9e52-4547-8548-6ca2e58e86a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:24.704981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad0bd1-9e52-4547-8548-6ca2e58e86a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:13:24.705982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: WARNING py.warnings [None req-cbad0bd1-9e52-4547-8548-6ca2e58e86a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:13:24.705982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: warnings.warn(msg) Jun 28 03:13:24.705982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: Jun 28 03:13:24.706888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad0bd1-9e52-4547-8548-6ca2e58e86a9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:13:24.720708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 752/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:13:24.725095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8876a4-9f98-4be2-b94f-f3178d7310cf admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:13:24.735989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8876a4-9f98-4be2-b94f-f3178d7310cf admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:13:24.741531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d825e-f251-4953-88d5-ef30048b5622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:13:24.742447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d825e-f251-4953-88d5-ef30048b5622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:24.742734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d825e-f251-4953-88d5-ef30048b5622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:24.743007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d825e-f251-4953-88d5-ef30048b5622 admin admin] PATH_INFO: `/v3/projects/c3d575347dfc4f41a368ee152a924093/users/2eabf9f141454be2821200fe0a024034/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:24.760326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d825e-f251-4953-88d5-ef30048b5622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d575347dfc4f41a368ee152a924093, user_id=2eabf9f141454be2821200fe0a024034, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:13:24.761360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: WARNING py.warnings [None req-1f0d825e-f251-4953-88d5-ef30048b5622 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:13:24.761360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: warnings.warn(msg) Jun 28 03:13:24.761360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: Jun 28 03:13:24.763350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d825e-f251-4953-88d5-ef30048b5622 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:13:24.779183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 749/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:13:24 2022] PUT /identity/v3/projects/c3d575347dfc4f41a368ee152a924093/users/2eabf9f141454be2821200fe0a024034/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:13:24.790631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47af0d-cee0-4880-b9b2-58607170a91b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:24.790920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47af0d-cee0-4880-b9b2-58607170a91b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:24.791192 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47af0d-cee0-4880-b9b2-58607170a91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:24.818730 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6b47af0d-cee0-4880-b9b2-58607170a91b None None] MFA Rules not processed for user `2eabf9f141454be2821200fe0a024034`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:13:24.819952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6b47af0d-cee0-4880-b9b2-58607170a91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:13:24.885820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 753/1502] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:13:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:13:24.899497 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6e6c-110b-47b2-abca-55d342de8855 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:24.899784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6e6c-110b-47b2-abca-55d342de8855 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:24.900096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6e6c-110b-47b2-abca-55d342de8855 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:24.901517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 750/1503] 10.222.0.23 () {54 vars in 963 bytes} [Tue Jun 28 03:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:13:24.906334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92877736-9913-4520-9868-569b3914cf59 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:24.906631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92877736-9913-4520-9868-569b3914cf59 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:24.906894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92877736-9913-4520-9868-569b3914cf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:24.925281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-92877736-9913-4520-9868-569b3914cf59 None None] MFA Rules not processed for user `0f8a5bc11b6745a196337b4dc48de14e`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:13:24.926480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-92877736-9913-4520-9868-569b3914cf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:13:24.981337 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:13:24.994284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 754/1504] 10.222.0.23 () {58 vars in 1060 bytes} [Tue Jun 28 03:13:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:13:25.002183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc6e6c-110b-47b2-abca-55d342de8855 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:13:25.013769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc6e6c-110b-47b2-abca-55d342de8855 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:13:25.018143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891953ae-8157-4faf-9123-60a2b602bff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:13:25.018833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891953ae-8157-4faf-9123-60a2b602bff2 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:25.019127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891953ae-8157-4faf-9123-60a2b602bff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:25.019397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891953ae-8157-4faf-9123-60a2b602bff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:25.028755 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891953ae-8157-4faf-9123-60a2b602bff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:13:25.030213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891953ae-8157-4faf-9123-60a2b602bff2 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:13:25.039818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 751/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:13:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:13:25.084220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55dd5-f6a7-48c6-ad3d-94fc3348c3fd None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:25.084505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55dd5-f6a7-48c6-ad3d-94fc3348c3fd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:25.084779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55dd5-f6a7-48c6-ad3d-94fc3348c3fd None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:25.086095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 755/1506] 10.222.0.23 () {52 vars in 829 bytes} [Tue Jun 28 03:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:13:25.090099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891953ae-8157-4faf-9123-60a2b602bff2 service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:13:25.156851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891953ae-8157-4faf-9123-60a2b602bff2 service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:13:25.162679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:13:25.163569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:25.163844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:25.164127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] PATH_INFO: `/v3/users/2eabf9f141454be2821200fe0a024034` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:25.165440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eabf9f141454be2821200fe0a024034)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:13:25.166496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: WARNING py.warnings [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:13:25.166496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: warnings.warn(msg) Jun 28 03:13:25.166496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: Jun 28 03:13:25.167721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:13:25.244266 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eabf9f141454be2821200fe0a024034'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:13:25.245139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eabf9f141454be2821200fe0a024034'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:13:25.258591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eabf9f141454be2821200fe0a024034'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:13:25.269089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eabf9f141454be2821200fe0a024034'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:13:25.285845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:13:25.288957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eabf9f141454be2821200fe0a024034'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:13:25.297164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 752/1507] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:13:25 2022] DELETE /identity/v3/users/2eabf9f141454be2821200fe0a024034 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:13:25.301946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792b10-2926-4611-a607-669f015b6ff6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:25.302747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792b10-2926-4611-a607-669f015b6ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:25.303021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792b10-2926-4611-a607-669f015b6ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:25.322656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ed792b10-2926-4611-a607-669f015b6ff6 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:13:25.323827 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ed792b10-2926-4611-a607-669f015b6ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:13:25.386201 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 756/1508] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:13:25.396858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:13:25.398412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:13:25.459743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e17ee-b164-4cc8-9c64-1b0afbc92f7a admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:13:25.464127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4157e5c-f721-49cf-bd36-4267e5862add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:13:25.464783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4157e5c-f721-49cf-bd36-4267e5862add service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:25.465089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4157e5c-f721-49cf-bd36-4267e5862add service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:25.465326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4157e5c-f721-49cf-bd36-4267e5862add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:25.475688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4157e5c-f721-49cf-bd36-4267e5862add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:13:25.477145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4157e5c-f721-49cf-bd36-4267e5862add service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:13:25.487588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 753/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:13:25.852269 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792b10-2926-4611-a607-669f015b6ff6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:13:25.853853 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ed792b10-2926-4611-a607-669f015b6ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:13:25.866769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792b10-2926-4611-a607-669f015b6ff6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:13:25.872618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:13:25.874689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:13:25.874979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:13:25.875434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] PATH_INFO: `/v3/projects/c3d575347dfc4f41a368ee152a924093` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:13:25.876639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d575347dfc4f41a368ee152a924093)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:13:25.877784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: WARNING py.warnings [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:13:25.877784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: warnings.warn(msg) Jun 28 03:13:25.877784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: Jun 28 03:13:25.879605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:13:25.942144 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d575347dfc4f41a368ee152a924093', 'request_id': 'req-aab49d2c-10c8-452e-a35c-06a44a3f4da0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:13:25.955685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d575347dfc4f41a368ee152a924093', 'request_id': 'req-aab49d2c-10c8-452e-a35c-06a44a3f4da0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:13:25.967490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d575347dfc4f41a368ee152a924093', 'request_id': 'req-aab49d2c-10c8-452e-a35c-06a44a3f4da0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:13:25.980081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] The token cache is being invalidate because project c3d575347dfc4f41a368ee152a924093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:13:25.980368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:13:25.981158 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-aab49d2c-10c8-452e-a35c-06a44a3f4da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:13:25.982857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 757/1510] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:13:25 2022] DELETE /identity/v3/projects/c3d575347dfc4f41a368ee152a924093 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:13:35.482937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:13:35.976644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:15:13.912861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34767f-7ac3-4a5c-83d5-07686d9acd41 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:13.913822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34767f-7ac3-4a5c-83d5-07686d9acd41 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:13.913822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34767f-7ac3-4a5c-83d5-07686d9acd41 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:13.916118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:15:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:15:13.922474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08623-840e-42a3-b4f8-71112c27c5e7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:13.923170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08623-840e-42a3-b4f8-71112c27c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:13.923483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08623-840e-42a3-b4f8-71112c27c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:13.947204 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-70a08623-840e-42a3-b4f8-71112c27c5e7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:15:13.948423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-70a08623-840e-42a3-b4f8-71112c27c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:14.011709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:15:14.166053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34767f-7ac3-4a5c-83d5-07686d9acd41 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:15:14.168959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9b34767f-7ac3-4a5c-83d5-07686d9acd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:14.267563 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34767f-7ac3-4a5c-83d5-07686d9acd41 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:15:14.274323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef11de0-77b2-4eb5-bf5f-d1acc353b2bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:15:14.275018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef11de0-77b2-4eb5-bf5f-d1acc353b2bf service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:14.275304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef11de0-77b2-4eb5-bf5f-d1acc353b2bf service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:14.275606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef11de0-77b2-4eb5-bf5f-d1acc353b2bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:14.284637 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef11de0-77b2-4eb5-bf5f-d1acc353b2bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:15:14.286258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef11de0-77b2-4eb5-bf5f-d1acc353b2bf service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:15:14.296305 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 755/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:15:15.118617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5825c5-bcc1-45b4-80d1-28f20d02c514 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:15.119078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5825c5-bcc1-45b4-80d1-28f20d02c514 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:15.119194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5825c5-bcc1-45b4-80d1-28f20d02c514 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:15.120655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:15:15.125957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee28ea-9a14-49d4-9ee1-6c27e91ee89a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:15.126450 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee28ea-9a14-49d4-9ee1-6c27e91ee89a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:15.126552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee28ea-9a14-49d4-9ee1-6c27e91ee89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:15.145772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-78ee28ea-9a14-49d4-9ee1-6c27e91ee89a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:15:15.147014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-78ee28ea-9a14-49d4-9ee1-6c27e91ee89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:15.156182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:15:15.244082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1728a-1e95-4436-8b54-9972d4f2cddc None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:15.244348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1728a-1e95-4436-8b54-9972d4f2cddc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:15.244610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1728a-1e95-4436-8b54-9972d4f2cddc None None] PATH_INFO: `/v3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:15.246050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 760/1516] 10.222.0.15 () {54 vars in 925 bytes} [Tue Jun 28 03:15:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:15:15.252886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65b413-259c-4501-954b-6f5b4df8cfc3 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:15.253168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65b413-259c-4501-954b-6f5b4df8cfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:15.253441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65b413-259c-4501-954b-6f5b4df8cfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:15.273891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-9d65b413-259c-4501-954b-6f5b4df8cfc3 None None] MFA Rules not processed for user `28b8048235c6421eae12ca99f80ed5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:15:15.275040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9d65b413-259c-4501-954b-6f5b4df8cfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:15.313192 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1728a-1e95-4436-8b54-9972d4f2cddc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:15:15.328136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1728a-1e95-4436-8b54-9972d4f2cddc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:15:15.333706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e6924-e6d4-4232-8c72-4807266412e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:15:15.334382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e6924-e6d4-4232-8c72-4807266412e0 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:15.334662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e6924-e6d4-4232-8c72-4807266412e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:15.334960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e6924-e6d4-4232-8c72-4807266412e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:15.341491 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 757/1517] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Jun 28 03:15:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:15:15.343660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e6924-e6d4-4232-8c72-4807266412e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:15:15.345315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e6924-e6d4-4232-8c72-4807266412e0 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:15:15.355424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 761/1518] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:15:24.311947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60c55d-addd-4a39-9c6e-3d57c6889b32 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:24.312513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60c55d-addd-4a39-9c6e-3d57c6889b32 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:24.312513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60c55d-addd-4a39-9c6e-3d57c6889b32 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:24.313755 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 758/1519] 10.222.0.23 () {54 vars in 960 bytes} [Tue Jun 28 03:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:15:24.319804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa8c40-2347-466c-8bc3-ff7797f1417a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:24.320274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa8c40-2347-466c-8bc3-ff7797f1417a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:24.320382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa8c40-2347-466c-8bc3-ff7797f1417a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:24.346835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a2fa8c40-2347-466c-8bc3-ff7797f1417a None None] MFA Rules not processed for user `28b8048235c6421eae12ca99f80ed5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:15:24.348020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a2fa8c40-2347-466c-8bc3-ff7797f1417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:24.358898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 762/1520] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Jun 28 03:15:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:15:24.366618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60c55d-addd-4a39-9c6e-3d57c6889b32 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:15:24.381346 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60c55d-addd-4a39-9c6e-3d57c6889b32 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:15:24.386488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a76bb-527b-4bb9-95af-c05b666d24f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8048235c6421eae12ca99f80ed5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:15:24.387113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a76bb-527b-4bb9-95af-c05b666d24f1 service placement] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:24.387389 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a76bb-527b-4bb9-95af-c05b666d24f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:24.387660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a76bb-527b-4bb9-95af-c05b666d24f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:24.396425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a76bb-527b-4bb9-95af-c05b666d24f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:15:24.397997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a76bb-527b-4bb9-95af-c05b666d24f1 service placement] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:15:24.408361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 759/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:15:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:15:26.597971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc2e3-ba83-4cdd-bad9-a77a76c2ad42 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:26.598605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc2e3-ba83-4cdd-bad9-a77a76c2ad42 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:26.598605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc2e3-ba83-4cdd-bad9-a77a76c2ad42 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:26.599979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:15:26.605399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeb9f2-294f-4712-b45a-6a9b3e7ebd12 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:26.605960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeb9f2-294f-4712-b45a-6a9b3e7ebd12 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:26.605960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeb9f2-294f-4712-b45a-6a9b3e7ebd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:26.624982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-56eeb9f2-294f-4712-b45a-6a9b3e7ebd12 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:15:26.626205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-56eeb9f2-294f-4712-b45a-6a9b3e7ebd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:26.635121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:15:26.793328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedc2e3-ba83-4cdd-bad9-a77a76c2ad42 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:15:26.812468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedc2e3-ba83-4cdd-bad9-a77a76c2ad42 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:15:26.819665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972af6a-f31f-450c-b9e4-827ccf0612b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:15:26.820307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972af6a-f31f-450c-b9e4-827ccf0612b6 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:26.820584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972af6a-f31f-450c-b9e4-827ccf0612b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:26.820850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972af6a-f31f-450c-b9e4-827ccf0612b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:26.829438 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972af6a-f31f-450c-b9e4-827ccf0612b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:15:26.831094 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972af6a-f31f-450c-b9e4-827ccf0612b6 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:15:26.841327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 764/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:15:27.656675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac03d01-4cec-48c0-a262-957bc7010572 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:27.657624 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac03d01-4cec-48c0-a262-957bc7010572 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:27.658102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac03d01-4cec-48c0-a262-957bc7010572 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:27.660761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 03:15:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:15:27.666898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0621-d7a8-4123-a964-dd40346fc98f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:27.667622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0621-d7a8-4123-a964-dd40346fc98f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:27.667806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0621-d7a8-4123-a964-dd40346fc98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:27.691461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-872c0621-d7a8-4123-a964-dd40346fc98f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:15:27.692651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-872c0621-d7a8-4123-a964-dd40346fc98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:27.701652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 03:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:15:27.857865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac03d01-4cec-48c0-a262-957bc7010572 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:15:27.874134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac03d01-4cec-48c0-a262-957bc7010572 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:15:27.882266 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934b633-bb72-407c-85b2-aee2952702f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:15:27.882944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934b633-bb72-407c-85b2-aee2952702f6 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:27.883230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934b633-bb72-407c-85b2-aee2952702f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:27.883486 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934b633-bb72-407c-85b2-aee2952702f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:27.892747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934b633-bb72-407c-85b2-aee2952702f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:15:27.894809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934b633-bb72-407c-85b2-aee2952702f6 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:15:27.905462 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 762/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:15:32.136462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba456-4b50-4035-8277-d5943f69f361 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:32.137095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba456-4b50-4035-8277-d5943f69f361 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:32.137095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba456-4b50-4035-8277-d5943f69f361 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:32.138935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:15:32.146807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2198f3e-cfed-42a6-b509-3e6512ad54d4 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:32.147273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2198f3e-cfed-42a6-b509-3e6512ad54d4 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:32.147378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2198f3e-cfed-42a6-b509-3e6512ad54d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:32.166366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e2198f3e-cfed-42a6-b509-3e6512ad54d4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:15:32.167558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e2198f3e-cfed-42a6-b509-3e6512ad54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:32.176677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:15:32.224987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decba456-4b50-4035-8277-d5943f69f361 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:15:32.227154 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-decba456-4b50-4035-8277-d5943f69f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:32.289071 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decba456-4b50-4035-8277-d5943f69f361 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:15:32.293304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e0548-fb8e-4352-9c64-7078d3ee6224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:15:32.293966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0548-fb8e-4352-9c64-7078d3ee6224 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:32.294249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0548-fb8e-4352-9c64-7078d3ee6224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:32.295203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0548-fb8e-4352-9c64-7078d3ee6224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:32.304975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e0548-fb8e-4352-9c64-7078d3ee6224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:15:32.306424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e0548-fb8e-4352-9c64-7078d3ee6224 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:15:32.316007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 767/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:15:34.358913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e36b-3601-4578-8887-6553c0a5b673 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:34.359469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e36b-3601-4578-8887-6553c0a5b673 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:34.359469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e36b-3601-4578-8887-6553c0a5b673 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:34.361168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:15:34.367882 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a2e7-1f60-4b19-8dff-c1cfb2c5dce7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:34.368340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a2e7-1f60-4b19-8dff-c1cfb2c5dce7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:34.368783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a2e7-1f60-4b19-8dff-c1cfb2c5dce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:34.394714 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8361a2e7-1f60-4b19-8dff-c1cfb2c5dce7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:15:34.396677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8361a2e7-1f60-4b19-8dff-c1cfb2c5dce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:34.406879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:15:34.448255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38e36b-3601-4578-8887-6553c0a5b673 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:15:34.451103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1f38e36b-3601-4578-8887-6553c0a5b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:34.468761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38e36b-3601-4578-8887-6553c0a5b673 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:15:34.473190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a479a9-9f00-4a12-ab6b-63ab1236093f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:15:34.473866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a479a9-9f00-4a12-ab6b-63ab1236093f service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:34.474150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a479a9-9f00-4a12-ab6b-63ab1236093f service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:34.474601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a479a9-9f00-4a12-ab6b-63ab1236093f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:34.485387 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a479a9-9f00-4a12-ab6b-63ab1236093f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:15:34.486880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a479a9-9f00-4a12-ab6b-63ab1236093f service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:15:34.496815 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 765/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:15:38.010164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf0678-7064-47c2-87e4-2c59f7789510 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:38.011213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf0678-7064-47c2-87e4-2c59f7789510 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:38.011213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf0678-7064-47c2-87e4-2c59f7789510 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:38.013236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:15:38.021280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f56e2-747e-4383-b4de-03746df82a2b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:38.021713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f56e2-747e-4383-b4de-03746df82a2b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:38.021813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f56e2-747e-4383-b4de-03746df82a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:38.029108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=91 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:15:38.042844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-fa2f56e2-747e-4383-b4de-03746df82a2b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:15:38.044051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fa2f56e2-747e-4383-b4de-03746df82a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:38.053398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:15:38.365752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf0678-7064-47c2-87e4-2c59f7789510 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:15:38.367762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-28bf0678-7064-47c2-87e4-2c59f7789510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:38.375048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=75 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:15:38.431057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf0678-7064-47c2-87e4-2c59f7789510 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:15:38.434972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab3cd8-4931-4105-8e57-f99f8e6542cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:15:38.435634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab3cd8-4931-4105-8e57-f99f8e6542cb service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:38.435934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab3cd8-4931-4105-8e57-f99f8e6542cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:38.436191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab3cd8-4931-4105-8e57-f99f8e6542cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:38.445766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab3cd8-4931-4105-8e57-f99f8e6542cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:15:38.447267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab3cd8-4931-4105-8e57-f99f8e6542cb service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:15:38.457564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 770/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:15:40.532073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d64c-4f9b-45e0-a52a-84b4cef0f33b None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:40.533025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d64c-4f9b-45e0-a52a-84b4cef0f33b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:40.533025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d64c-4f9b-45e0-a52a-84b4cef0f33b None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:40.536355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 03:15:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:15:40.542854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f807160-ecd1-43d7-aee9-350ac31598a9 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:40.543576 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f807160-ecd1-43d7-aee9-350ac31598a9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:40.543758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f807160-ecd1-43d7-aee9-350ac31598a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:40.567100 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8f807160-ecd1-43d7-aee9-350ac31598a9 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:15:40.569110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8f807160-ecd1-43d7-aee9-350ac31598a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:40.582746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 03:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:15:40.881051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6d64c-4f9b-45e0-a52a-84b4cef0f33b None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:15:40.883073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-45d6d64c-4f9b-45e0-a52a-84b4cef0f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:15:40.904301 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6d64c-4f9b-45e0-a52a-84b4cef0f33b None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:15:40.909516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f080289-d726-472e-942d-6b182bb66b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:15:40.910154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f080289-d726-472e-942d-6b182bb66b85 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:15:40.910467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f080289-d726-472e-942d-6b182bb66b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:15:40.910723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f080289-d726-472e-942d-6b182bb66b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:15:40.921059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f080289-d726-472e-942d-6b182bb66b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:15:40.922530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f080289-d726-472e-942d-6b182bb66b85 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:15:40.932365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 768/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:15:50.560661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=28 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:15:50.928200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=8 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:12.645344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58d765-f262-41da-bf38-826659bca9f6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:12.646023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58d765-f262-41da-bf38-826659bca9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:12.646023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58d765-f262-41da-bf38-826659bca9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:12.676829 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ca58d765-f262-41da-bf38-826659bca9f6 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:12.678077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ca58d765-f262-41da-bf38-826659bca9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:12.693984 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 772/1540] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:12.703629 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d07012-c038-42d4-9143-9de85ded47f5 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:12.704273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d07012-c038-42d4-9143-9de85ded47f5 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:12.704273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d07012-c038-42d4-9143-9de85ded47f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:12.734757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-12d07012-c038-42d4-9143-9de85ded47f5 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:12.736051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-12d07012-c038-42d4-9143-9de85ded47f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:12.749710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 769/1541] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:12.754546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58d765-f262-41da-bf38-826659bca9f6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:12.769824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58d765-f262-41da-bf38-826659bca9f6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:12.777004 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afcded-ef8f-4f8b-9591-14274286a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:12.777997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afcded-ef8f-4f8b-9591-14274286a9fd admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:12.778522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afcded-ef8f-4f8b-9591-14274286a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:12.779140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afcded-ef8f-4f8b-9591-14274286a9fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:12.780096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afcded-ef8f-4f8b-9591-14274286a9fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:12.780579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afcded-ef8f-4f8b-9591-14274286a9fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:12.782421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afcded-ef8f-4f8b-9591-14274286a9fd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:12.809221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 773/1542] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:12.812389 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dd082-03e0-45ca-a257-e2808aa71f16 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:12.812682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dd082-03e0-45ca-a257-e2808aa71f16 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:12.812951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dd082-03e0-45ca-a257-e2808aa71f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:12.823692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afcded-ef8f-4f8b-9591-14274286a9fd admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:12.835014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afcded-ef8f-4f8b-9591-14274286a9fd admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:12.847568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-be8dd082-03e0-45ca-a257-e2808aa71f16 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:12.848809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-be8dd082-03e0-45ca-a257-e2808aa71f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:12.850509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e59fe-68c9-4292-84d2-a73c9b935ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:12.851803 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e59fe-68c9-4292-84d2-a73c9b935ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:12.852291 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e59fe-68c9-4292-84d2-a73c9b935ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:12.852781 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e59fe-68c9-4292-84d2-a73c9b935ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:12.853696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e59fe-68c9-4292-84d2-a73c9b935ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:12.854970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: WARNING py.warnings [None req-be2e59fe-68c9-4292-84d2-a73c9b935ab8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:17:12.854970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: warnings.warn(msg) Jun 28 03:17:12.854970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: Jun 28 03:17:12.856922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e59fe-68c9-4292-84d2-a73c9b935ab8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:12.869906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 770/1543] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:12.871470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008f4a-7807-4ee9-a14c-d1b929094831 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:12.871766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008f4a-7807-4ee9-a14c-d1b929094831 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:12.872459 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008f4a-7807-4ee9-a14c-d1b929094831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:12.908017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-42008f4a-7807-4ee9-a14c-d1b929094831 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:12.909503 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-42008f4a-7807-4ee9-a14c-d1b929094831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:12.920223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 774/1544] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:12 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:17:12.926120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ffe36-89b4-4732-aa14-eb72ce153e42 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:12.926445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ffe36-89b4-4732-aa14-eb72ce153e42 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:12.926725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ffe36-89b4-4732-aa14-eb72ce153e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:12.931404 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 771/1545] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:12.932737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5f85d-1f00-4158-8e70-93661e791170 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:12.933026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5f85d-1f00-4158-8e70-93661e791170 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:12.933305 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5f85d-1f00-4158-8e70-93661e791170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:12.958165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a91ffe36-89b4-4732-aa14-eb72ce153e42 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:12.959408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a91ffe36-89b4-4732-aa14-eb72ce153e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:12.972704 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-cea5f85d-1f00-4158-8e70-93661e791170 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:12.974253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cea5f85d-1f00-4158-8e70-93661e791170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:13.040366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 772/1546] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.041200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5f85d-1f00-4158-8e70-93661e791170 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.042145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 775/1547] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.044605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aa193-6346-4a22-8af5-e5474fb60c04 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.044605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aa193-6346-4a22-8af5-e5474fb60c04 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.044605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aa193-6346-4a22-8af5-e5474fb60c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.053686 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5f85d-1f00-4158-8e70-93661e791170 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.061440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d957-a147-4631-85e8-7af596be924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.062139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d957-a147-4631-85e8-7af596be924d admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.062455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d957-a147-4631-85e8-7af596be924d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.062733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d957-a147-4631-85e8-7af596be924d admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.063448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d957-a147-4631-85e8-7af596be924d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.064504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: WARNING py.warnings [None req-aec8d957-a147-4631-85e8-7af596be924d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:17:13.064504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: warnings.warn(msg) Jun 28 03:17:13.064504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: Jun 28 03:17:13.065997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d957-a147-4631-85e8-7af596be924d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.066462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6f4aa193-6346-4a22-8af5-e5474fb60c04 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:13.067835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6f4aa193-6346-4a22-8af5-e5474fb60c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:13.075677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 776/1548] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.076917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0733ab-4aa6-40bb-a30b-82aeec941d6c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.077196 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0733ab-4aa6-40bb-a30b-82aeec941d6c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.077466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0733ab-4aa6-40bb-a30b-82aeec941d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.090366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 773/1549] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:13.092146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634ccf4-3b94-4980-bd9c-1f3556cd58ad None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.092443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634ccf4-3b94-4980-bd9c-1f3556cd58ad None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.092722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634ccf4-3b94-4980-bd9c-1f3556cd58ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.099331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8c0733ab-4aa6-40bb-a30b-82aeec941d6c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:13.101683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8c0733ab-4aa6-40bb-a30b-82aeec941d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:13.109818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 777/1550] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.110716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8634ccf4-3b94-4980-bd9c-1f3556cd58ad None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:13.111174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b792b1e-c2b6-445c-82d0-ca962e5b60a7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.111711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b792b1e-c2b6-445c-82d0-ca962e5b60a7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.111919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8634ccf4-3b94-4980-bd9c-1f3556cd58ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:13.112101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b792b1e-c2b6-445c-82d0-ca962e5b60a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.120048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 774/1551] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.121269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc984dd0-17d4-4746-9f8d-d468d06a5195 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.121565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc984dd0-17d4-4746-9f8d-d468d06a5195 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.122235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc984dd0-17d4-4746-9f8d-d468d06a5195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.131628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8b792b1e-c2b6-445c-82d0-ca962e5b60a7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:13.132801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8b792b1e-c2b6-445c-82d0-ca962e5b60a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:13.139899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-dc984dd0-17d4-4746-9f8d-d468d06a5195 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:13.140692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 778/1552] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.141039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-dc984dd0-17d4-4746-9f8d-d468d06a5195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:13.141442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b792b1e-c2b6-445c-82d0-ca962e5b60a7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.150110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 775/1553] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.151021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b792b1e-c2b6-445c-82d0-ca962e5b60a7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.151488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df237c-6816-49e0-9ef8-a0ce11879e89 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.151782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df237c-6816-49e0-9ef8-a0ce11879e89 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.152093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df237c-6816-49e0-9ef8-a0ce11879e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.155770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207f0a8-c5b5-4679-8895-f913cb67e09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.156459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207f0a8-c5b5-4679-8895-f913cb67e09e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.156693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207f0a8-c5b5-4679-8895-f913cb67e09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.157042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207f0a8-c5b5-4679-8895-f913cb67e09e admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.157804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207f0a8-c5b5-4679-8895-f913cb67e09e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:13.158164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207f0a8-c5b5-4679-8895-f913cb67e09e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.159816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207f0a8-c5b5-4679-8895-f913cb67e09e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.170159 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-02df237c-6816-49e0-9ef8-a0ce11879e89 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:13.171385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-02df237c-6816-49e0-9ef8-a0ce11879e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:13.171609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 779/1554] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:13.172929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a2c6d-4b24-4cda-b167-911bc27dfd5b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.173211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a2c6d-4b24-4cda-b167-911bc27dfd5b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.173522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a2c6d-4b24-4cda-b167-911bc27dfd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.180140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 776/1555] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.181699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df237c-6816-49e0-9ef8-a0ce11879e89 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.191315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df237c-6816-49e0-9ef8-a0ce11879e89 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.195878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893bb81-aabd-4138-81c2-3283effcfa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.196537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893bb81-aabd-4138-81c2-3283effcfa6f admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.196698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-160a2c6d-4b24-4cda-b167-911bc27dfd5b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:13.196819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893bb81-aabd-4138-81c2-3283effcfa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.197075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893bb81-aabd-4138-81c2-3283effcfa6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.197806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893bb81-aabd-4138-81c2-3283effcfa6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.197908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-160a2c6d-4b24-4cda-b167-911bc27dfd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:13.199465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893bb81-aabd-4138-81c2-3283effcfa6f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.209480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 780/1556] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.209480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a2c6d-4b24-4cda-b167-911bc27dfd5b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.210096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 777/1557] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:13.211464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802309-de59-4e2a-a6fc-aa657f7f4c1a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.211801 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802309-de59-4e2a-a6fc-aa657f7f4c1a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.212028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802309-de59-4e2a-a6fc-aa657f7f4c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.216764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a2c6d-4b24-4cda-b167-911bc27dfd5b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.221449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f7ffc-93b7-4110-bbe4-36a9ad2bffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.222094 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f7ffc-93b7-4110-bbe4-36a9ad2bffc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.222397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f7ffc-93b7-4110-bbe4-36a9ad2bffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.222669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f7ffc-93b7-4110-bbe4-36a9ad2bffc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.223382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f7ffc-93b7-4110-bbe4-36a9ad2bffc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:13.223678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f7ffc-93b7-4110-bbe4-36a9ad2bffc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.225266 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f7ffc-93b7-4110-bbe4-36a9ad2bffc7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.229930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-45802309-de59-4e2a-a6fc-aa657f7f4c1a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:13.231289 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-45802309-de59-4e2a-a6fc-aa657f7f4c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:13.237112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 781/1558] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:13.238417 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415364cc-d5a9-409c-ae76-b55e30dead6d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.238698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415364cc-d5a9-409c-ae76-b55e30dead6d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.238972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415364cc-d5a9-409c-ae76-b55e30dead6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.246153 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 778/1559] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.247557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc00713-e654-43fe-b1db-2cd8693029e4 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.247920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc00713-e654-43fe-b1db-2cd8693029e4 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.248202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc00713-e654-43fe-b1db-2cd8693029e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.257845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-415364cc-d5a9-409c-ae76-b55e30dead6d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:13.259117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-415364cc-d5a9-409c-ae76-b55e30dead6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:13.267339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7cc00713-e654-43fe-b1db-2cd8693029e4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:13.268725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7cc00713-e654-43fe-b1db-2cd8693029e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:13.272356 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 782/1560] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.273147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415364cc-d5a9-409c-ae76-b55e30dead6d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.280914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 779/1561] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:13.282425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc00713-e654-43fe-b1db-2cd8693029e4 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.289035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415364cc-d5a9-409c-ae76-b55e30dead6d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.293349 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc00713-e654-43fe-b1db-2cd8693029e4 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.294176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857cf0c-62e8-49c6-9769-0aabc8d9881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.294846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857cf0c-62e8-49c6-9769-0aabc8d9881b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.295138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857cf0c-62e8-49c6-9769-0aabc8d9881b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.295377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857cf0c-62e8-49c6-9769-0aabc8d9881b admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.296082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857cf0c-62e8-49c6-9769-0aabc8d9881b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.298013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857cf0c-62e8-49c6-9769-0aabc8d9881b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.298262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9dacf-c71f-4c68-9eae-6eafc68b0e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.299014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9dacf-c71f-4c68-9eae-6eafc68b0e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.299325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9dacf-c71f-4c68-9eae-6eafc68b0e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.299611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9dacf-c71f-4c68-9eae-6eafc68b0e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.300361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9dacf-c71f-4c68-9eae-6eafc68b0e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:13.300670 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9dacf-c71f-4c68-9eae-6eafc68b0e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.301706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: WARNING py.warnings [None req-7ef9dacf-c71f-4c68-9eae-6eafc68b0e75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:17:13.301706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: warnings.warn(msg) Jun 28 03:17:13.301706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: Jun 28 03:17:13.302661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9dacf-c71f-4c68-9eae-6eafc68b0e75 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.314571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 780/1562] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:13.315524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9dacf-c71f-4c68-9eae-6eafc68b0e75 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.326896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9dacf-c71f-4c68-9eae-6eafc68b0e75 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.328211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 783/1563] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:13.329061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857cf0c-62e8-49c6-9769-0aabc8d9881b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.371154 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:13.386642 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab639590-ab86-476c-b766-af8ea85374f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.387327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab639590-ab86-476c-b766-af8ea85374f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.387606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab639590-ab86-476c-b766-af8ea85374f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.387876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab639590-ab86-476c-b766-af8ea85374f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.388767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab639590-ab86-476c-b766-af8ea85374f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:13.389069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab639590-ab86-476c-b766-af8ea85374f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.391410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab639590-ab86-476c-b766-af8ea85374f8 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.392884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857cf0c-62e8-49c6-9769-0aabc8d9881b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.397404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3ccdd-4036-420f-bfe0-2dffc3e5fe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.398077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3ccdd-4036-420f-bfe0-2dffc3e5fe7d admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.398387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3ccdd-4036-420f-bfe0-2dffc3e5fe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.398664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3ccdd-4036-420f-bfe0-2dffc3e5fe7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.399390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3ccdd-4036-420f-bfe0-2dffc3e5fe7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.400466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:13.400993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3ccdd-4036-420f-bfe0-2dffc3e5fe7d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.406594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 781/1564] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:13.407944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab639590-ab86-476c-b766-af8ea85374f8 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.414631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 784/1565] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:13.414631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3ccdd-4036-420f-bfe0-2dffc3e5fe7d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.419240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab639590-ab86-476c-b766-af8ea85374f8 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.421891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3ccdd-4036-420f-bfe0-2dffc3e5fe7d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.424138 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648df69-a11a-45d2-b0dd-469fb1763aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.424881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648df69-a11a-45d2-b0dd-469fb1763aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.425167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648df69-a11a-45d2-b0dd-469fb1763aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.425441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648df69-a11a-45d2-b0dd-469fb1763aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.426140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648df69-a11a-45d2-b0dd-469fb1763aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.426700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae8777-1efc-4a59-9064-709f20a554c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.427345 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8777-1efc-4a59-9064-709f20a554c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.427624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8777-1efc-4a59-9064-709f20a554c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.427897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8777-1efc-4a59-9064-709f20a554c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.428079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648df69-a11a-45d2-b0dd-469fb1763aa5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.428622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8777-1efc-4a59-9064-709f20a554c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:13.428930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8777-1efc-4a59-9064-709f20a554c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.430528 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8777-1efc-4a59-9064-709f20a554c5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.442655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 785/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:13.443754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae8777-1efc-4a59-9064-709f20a554c5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.454217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae8777-1efc-4a59-9064-709f20a554c5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.457695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 782/1567] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:13.458695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648df69-a11a-45d2-b0dd-469fb1763aa5 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.462083 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9fb17-8d8d-4bab-b748-f0ffaafd42b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.462767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9fb17-8d8d-4bab-b748-f0ffaafd42b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.463051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9fb17-8d8d-4bab-b748-f0ffaafd42b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.463327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9fb17-8d8d-4bab-b748-f0ffaafd42b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.464056 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9fb17-8d8d-4bab-b748-f0ffaafd42b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:13.464362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9fb17-8d8d-4bab-b748-f0ffaafd42b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.465957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9fb17-8d8d-4bab-b748-f0ffaafd42b6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.485297 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 786/1568] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:13.485297 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9fb17-8d8d-4bab-b748-f0ffaafd42b6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.494545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9fb17-8d8d-4bab-b748-f0ffaafd42b6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.523292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648df69-a11a-45d2-b0dd-469fb1763aa5 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.527857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0d7a4-c46b-45b8-aaf9-807897a1b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.528527 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0d7a4-c46b-45b8-aaf9-807897a1b8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.528809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0d7a4-c46b-45b8-aaf9-807897a1b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.529083 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0d7a4-c46b-45b8-aaf9-807897a1b8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.529809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0d7a4-c46b-45b8-aaf9-807897a1b8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:13.530115 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0d7a4-c46b-45b8-aaf9-807897a1b8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.531795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0d7a4-c46b-45b8-aaf9-807897a1b8aa admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.543387 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 783/1569] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:13.544157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0d7a4-c46b-45b8-aaf9-807897a1b8aa admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.553877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0d7a4-c46b-45b8-aaf9-807897a1b8aa admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.558200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267b656-0fa2-4680-b1c6-70565ea07d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.558523 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d1fa6-99d7-4067-aef7-5ecb52a9a373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.558941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267b656-0fa2-4680-b1c6-70565ea07d95 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.559170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d1fa6-99d7-4067-aef7-5ecb52a9a373 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.559286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267b656-0fa2-4680-b1c6-70565ea07d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.559456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267b656-0fa2-4680-b1c6-70565ea07d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.559568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d1fa6-99d7-4067-aef7-5ecb52a9a373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.559735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d1fa6-99d7-4067-aef7-5ecb52a9a373 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.560166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267b656-0fa2-4680-b1c6-70565ea07d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.560426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d1fa6-99d7-4067-aef7-5ecb52a9a373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.562089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267b656-0fa2-4680-b1c6-70565ea07d95 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.562317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d1fa6-99d7-4067-aef7-5ecb52a9a373 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.583883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 784/1570] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:13.587107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d1fa6-99d7-4067-aef7-5ecb52a9a373 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.593472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 787/1571] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:13.593472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267b656-0fa2-4680-b1c6-70565ea07d95 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.598557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d1fa6-99d7-4067-aef7-5ecb52a9a373 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.653641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267b656-0fa2-4680-b1c6-70565ea07d95 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.655932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515a8ed-00f4-4fd5-b115-d556c8269b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.656850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515a8ed-00f4-4fd5-b115-d556c8269b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.657163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515a8ed-00f4-4fd5-b115-d556c8269b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.657425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515a8ed-00f4-4fd5-b115-d556c8269b93 admin admin] PATH_INFO: `/v3/projects/54a71e62822b47038c55b24dc66f2878/users/699673c30c364a68a61e4887c25021d1/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.658987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc05e3-c948-4f4e-b0bd-7b41b1068ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.659585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc05e3-c948-4f4e-b0bd-7b41b1068ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.660041 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc05e3-c948-4f4e-b0bd-7b41b1068ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.660324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc05e3-c948-4f4e-b0bd-7b41b1068ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.661799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc05e3-c948-4f4e-b0bd-7b41b1068ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.664053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc05e3-c948-4f4e-b0bd-7b41b1068ebe admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.672564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515a8ed-00f4-4fd5-b115-d556c8269b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a71e62822b47038c55b24dc66f2878, user_id=699673c30c364a68a61e4887c25021d1, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.675466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515a8ed-00f4-4fd5-b115-d556c8269b93 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.689647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 785/1572] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:13 2022] PUT /identity/v3/projects/54a71e62822b47038c55b24dc66f2878/users/699673c30c364a68a61e4887c25021d1/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:13.690565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515a8ed-00f4-4fd5-b115-d556c8269b93 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.694808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 788/1573] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:13.694808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc05e3-c948-4f4e-b0bd-7b41b1068ebe admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.715025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:13.738024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:13.758794 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc05e3-c948-4f4e-b0bd-7b41b1068ebe admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.760392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515a8ed-00f4-4fd5-b115-d556c8269b93 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.763551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c174105-89c2-4797-b593-2a030b3ea8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.764239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c174105-89c2-4797-b593-2a030b3ea8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.764525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c174105-89c2-4797-b593-2a030b3ea8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.764810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c174105-89c2-4797-b593-2a030b3ea8ca admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.765188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008c12e-c994-4970-916e-47699c337565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.765508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c174105-89c2-4797-b593-2a030b3ea8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.765851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008c12e-c994-4970-916e-47699c337565 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.766128 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008c12e-c994-4970-916e-47699c337565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.766433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008c12e-c994-4970-916e-47699c337565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.767116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008c12e-c994-4970-916e-47699c337565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.767474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c174105-89c2-4797-b593-2a030b3ea8ca admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.769566 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008c12e-c994-4970-916e-47699c337565 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.787474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 789/1574] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:13.788307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c174105-89c2-4797-b593-2a030b3ea8ca admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.797760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c174105-89c2-4797-b593-2a030b3ea8ca admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.802912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 786/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:13.802912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008c12e-c994-4970-916e-47699c337565 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.856265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec47b4-7e99-483d-bade-b78468ed0412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.856932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec47b4-7e99-483d-bade-b78468ed0412 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.857211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec47b4-7e99-483d-bade-b78468ed0412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.857481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec47b4-7e99-483d-bade-b78468ed0412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.858169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec47b4-7e99-483d-bade-b78468ed0412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.860156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec47b4-7e99-483d-bade-b78468ed0412 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.861561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008c12e-c994-4970-916e-47699c337565 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.866778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ee889-5e9e-48d9-baeb-f0f1d45a82f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.867455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee889-5e9e-48d9-baeb-f0f1d45a82f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.867738 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee889-5e9e-48d9-baeb-f0f1d45a82f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.868009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee889-5e9e-48d9-baeb-f0f1d45a82f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.868821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ee889-5e9e-48d9-baeb-f0f1d45a82f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.870795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ee889-5e9e-48d9-baeb-f0f1d45a82f5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.886888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 790/1576] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:13.890281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec47b4-7e99-483d-bade-b78468ed0412 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.898910 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 787/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:13.899895 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ee889-5e9e-48d9-baeb-f0f1d45a82f5 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.949982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec47b4-7e99-483d-bade-b78468ed0412 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.955175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cecd0-cd5b-4769-b3f4-00ced7e04e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.956333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cecd0-cd5b-4769-b3f4-00ced7e04e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.956620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cecd0-cd5b-4769-b3f4-00ced7e04e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.956890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cecd0-cd5b-4769-b3f4-00ced7e04e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.957624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cecd0-cd5b-4769-b3f4-00ced7e04e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.959210 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ee889-5e9e-48d9-baeb-f0f1d45a82f5 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.959345 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cecd0-cd5b-4769-b3f4-00ced7e04e2b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.963790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c6b66-7ea0-46bb-8ae4-121099aecf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.964479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6b66-7ea0-46bb-8ae4-121099aecf77 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.964779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6b66-7ea0-46bb-8ae4-121099aecf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.965047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6b66-7ea0-46bb-8ae4-121099aecf77 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.965716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c6b66-7ea0-46bb-8ae4-121099aecf77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.967655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c6b66-7ea0-46bb-8ae4-121099aecf77 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.969373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 791/1578] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:13.970140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cecd0-cd5b-4769-b3f4-00ced7e04e2b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:13.980852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cecd0-cd5b-4769-b3f4-00ced7e04e2b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:13.985977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7208ab-54b0-40f3-afea-001a59942c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:13.986742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7208ab-54b0-40f3-afea-001a59942c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.987110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7208ab-54b0-40f3-afea-001a59942c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.987391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7208ab-54b0-40f3-afea-001a59942c0b admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:13.988084 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7208ab-54b0-40f3-afea-001a59942c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:13.992396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 788/1579] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:13.992550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7208ab-54b0-40f3-afea-001a59942c0b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:13.992660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0b8f-23db-45e4-85f2-7b08a494b5ba None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:13.992660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0b8f-23db-45e4-85f2-7b08a494b5ba None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:13.992660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0b8f-23db-45e4-85f2-7b08a494b5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.012509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 792/1580] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:14.013323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7208ab-54b0-40f3-afea-001a59942c0b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.019957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-866d0b8f-23db-45e4-85f2-7b08a494b5ba None None] MFA Rules not processed for user `699673c30c364a68a61e4887c25021d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:14.021171 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-866d0b8f-23db-45e4-85f2-7b08a494b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:14.022691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7208ab-54b0-40f3-afea-001a59942c0b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.027202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccaf5f-55e4-428b-84ff-77faa72c7a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.027892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccaf5f-55e4-428b-84ff-77faa72c7a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.028166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccaf5f-55e4-428b-84ff-77faa72c7a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.028440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccaf5f-55e4-428b-84ff-77faa72c7a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.029166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccaf5f-55e4-428b-84ff-77faa72c7a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.031207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccaf5f-55e4-428b-84ff-77faa72c7a0c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.036427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:14.048458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 793/1581] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.049628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccaf5f-55e4-428b-84ff-77faa72c7a0c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.050653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:14.060332 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccaf5f-55e4-428b-84ff-77faa72c7a0c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.065535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221177-d2ea-409d-9940-a9db694aea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.066212 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221177-d2ea-409d-9940-a9db694aea0a admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.066589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221177-d2ea-409d-9940-a9db694aea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.066866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221177-d2ea-409d-9940-a9db694aea0a admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.067566 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58221177-d2ea-409d-9940-a9db694aea0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.069512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58221177-d2ea-409d-9940-a9db694aea0a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.090383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 794/1582] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:14 2022] POST /identity/v3/users => generated 291 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:14.094178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221177-d2ea-409d-9940-a9db694aea0a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.094455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 789/1583] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:14.095123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d0b8f-23db-45e4-85f2-7b08a494b5ba None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.106320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d0b8f-23db-45e4-85f2-7b08a494b5ba None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.109712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221177-d2ea-409d-9940-a9db694aea0a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.110925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5bc9f-304a-4653-b811-77f72fd74ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.111771 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5bc9f-304a-4653-b811-77f72fd74ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.112134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5bc9f-304a-4653-b811-77f72fd74ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.112418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5bc9f-304a-4653-b811-77f72fd74ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.113552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5bc9f-304a-4653-b811-77f72fd74ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.115281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5bc9f-304a-4653-b811-77f72fd74ee3 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.116217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709289b-8069-455f-a52c-a8e665e3a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.117328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709289b-8069-455f-a52c-a8e665e3a170 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.117795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709289b-8069-455f-a52c-a8e665e3a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.118272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709289b-8069-455f-a52c-a8e665e3a170 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.119100 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709289b-8069-455f-a52c-a8e665e3a170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.121031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709289b-8069-455f-a52c-a8e665e3a170 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.143580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 790/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:14 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:14.144826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5bc9f-304a-4653-b811-77f72fd74ee3 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.148905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 795/1585] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:14 2022] POST /identity/v3/users => generated 288 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:14.149610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709289b-8069-455f-a52c-a8e665e3a170 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.155183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5bc9f-304a-4653-b811-77f72fd74ee3 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.160106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646239a-9c52-4c7a-afc5-24b6c2669d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.160783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646239a-9c52-4c7a-afc5-24b6c2669d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.161065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646239a-9c52-4c7a-afc5-24b6c2669d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.161223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709289b-8069-455f-a52c-a8e665e3a170 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.161326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646239a-9c52-4c7a-afc5-24b6c2669d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.162064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646239a-9c52-4c7a-afc5-24b6c2669d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.163705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646239a-9c52-4c7a-afc5-24b6c2669d0c admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.165946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252be4fa-73ff-4102-9a1a-38bd9c5d3a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.166670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252be4fa-73ff-4102-9a1a-38bd9c5d3a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.166949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252be4fa-73ff-4102-9a1a-38bd9c5d3a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.167222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252be4fa-73ff-4102-9a1a-38bd9c5d3a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.167934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252be4fa-73ff-4102-9a1a-38bd9c5d3a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.169510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252be4fa-73ff-4102-9a1a-38bd9c5d3a81 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.173793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 791/1586] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.174820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646239a-9c52-4c7a-afc5-24b6c2669d0c admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.183312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 796/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.183312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252be4fa-73ff-4102-9a1a-38bd9c5d3a81 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.187470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646239a-9c52-4c7a-afc5-24b6c2669d0c admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.190732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252be4fa-73ff-4102-9a1a-38bd9c5d3a81 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.192203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11bc34-b184-4cd2-9f6d-fcd2d9499efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.192885 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11bc34-b184-4cd2-9f6d-fcd2d9499efc admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.193168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11bc34-b184-4cd2-9f6d-fcd2d9499efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.193440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11bc34-b184-4cd2-9f6d-fcd2d9499efc admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.194168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11bc34-b184-4cd2-9f6d-fcd2d9499efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.195222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e073aa5-0d57-46b4-b307-36296b2e4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.195803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11bc34-b184-4cd2-9f6d-fcd2d9499efc admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.195917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e073aa5-0d57-46b4-b307-36296b2e4c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.196128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e073aa5-0d57-46b4-b307-36296b2e4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.196401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e073aa5-0d57-46b4-b307-36296b2e4c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.197114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e073aa5-0d57-46b4-b307-36296b2e4c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.198727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e073aa5-0d57-46b4-b307-36296b2e4c0d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.206378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 792/1588] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.207273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11bc34-b184-4cd2-9f6d-fcd2d9499efc admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.211687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 797/1589] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.212930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fafb3-ce3b-4b18-8997-9a08ddd20880 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.213221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fafb3-ce3b-4b18-8997-9a08ddd20880 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.213496 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fafb3-ce3b-4b18-8997-9a08ddd20880 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.214982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 798/1590] 10.222.0.23 () {54 vars in 961 bytes} [Tue Jun 28 03:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:17:14.215673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fafb3-ce3b-4b18-8997-9a08ddd20880 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.217659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11bc34-b184-4cd2-9f6d-fcd2d9499efc admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.222648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c30a6-8bfe-4063-bcd8-716d59f31dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.223313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c30a6-8bfe-4063-bcd8-716d59f31dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.223598 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c30a6-8bfe-4063-bcd8-716d59f31dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.223881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c30a6-8bfe-4063-bcd8-716d59f31dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.224609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c30a6-8bfe-4063-bcd8-716d59f31dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.226608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c30a6-8bfe-4063-bcd8-716d59f31dd2 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.228325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fafb3-ce3b-4b18-8997-9a08ddd20880 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.232867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1d86a-1171-40bf-b589-8a1ba4d38dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.233493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d86a-1171-40bf-b589-8a1ba4d38dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.233778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d86a-1171-40bf-b589-8a1ba4d38dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.234058 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d86a-1171-40bf-b589-8a1ba4d38dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.234808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1d86a-1171-40bf-b589-8a1ba4d38dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.236403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1d86a-1171-40bf-b589-8a1ba4d38dd0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.237132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 793/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.240305 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c30a6-8bfe-4063-bcd8-716d59f31dd2 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.246833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 799/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.247598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1d86a-1171-40bf-b589-8a1ba4d38dd0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.249188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c30a6-8bfe-4063-bcd8-716d59f31dd2 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.254756 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925192b3-3999-458b-888c-1edd898408c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.255419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925192b3-3999-458b-888c-1edd898408c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.255726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925192b3-3999-458b-888c-1edd898408c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.256001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925192b3-3999-458b-888c-1edd898408c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.256731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925192b3-3999-458b-888c-1edd898408c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.257369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1d86a-1171-40bf-b589-8a1ba4d38dd0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.258328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925192b3-3999-458b-888c-1edd898408c8 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.261992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f33e59-9841-4157-ac35-9cab805461f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.262887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f33e59-9841-4157-ac35-9cab805461f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.263184 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f33e59-9841-4157-ac35-9cab805461f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.263441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f33e59-9841-4157-ac35-9cab805461f8 admin admin] PATH_INFO: `/v3/projects/99b37f6e28d847c5beabb543147d3310/users/db3affb5714e4cf5a0220866a61e8c69/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.268711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 794/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.268711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925192b3-3999-458b-888c-1edd898408c8 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.278131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f33e59-9841-4157-ac35-9cab805461f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b37f6e28d847c5beabb543147d3310, user_id=db3affb5714e4cf5a0220866a61e8c69, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.279139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: WARNING py.warnings [None req-b8f33e59-9841-4157-ac35-9cab805461f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:17:14.279139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: warnings.warn(msg) Jun 28 03:17:14.279139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: Jun 28 03:17:14.279563 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925192b3-3999-458b-888c-1edd898408c8 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.281038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f33e59-9841-4157-ac35-9cab805461f8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.284848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1242ad7-b57a-4e22-9ae0-b6358051727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.285627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1242ad7-b57a-4e22-9ae0-b6358051727b admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.286017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1242ad7-b57a-4e22-9ae0-b6358051727b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.286316 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1242ad7-b57a-4e22-9ae0-b6358051727b admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.287144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1242ad7-b57a-4e22-9ae0-b6358051727b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.288866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1242ad7-b57a-4e22-9ae0-b6358051727b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.295856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 800/1594] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:14 2022] PUT /identity/v3/projects/99b37f6e28d847c5beabb543147d3310/users/db3affb5714e4cf5a0220866a61e8c69/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:14.310518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f33e59-9841-4157-ac35-9cab805461f8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.310681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 795/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.310681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1242ad7-b57a-4e22-9ae0-b6358051727b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.311929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1242ad7-b57a-4e22-9ae0-b6358051727b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.368002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146343ef-ccf5-4885-a0b1-55367e44e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.368898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146343ef-ccf5-4885-a0b1-55367e44e053 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.369046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f33e59-9841-4157-ac35-9cab805461f8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.369175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146343ef-ccf5-4885-a0b1-55367e44e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.369432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146343ef-ccf5-4885-a0b1-55367e44e053 admin admin] PATH_INFO: `/v3/projects/ccc93255837e4cea8443fe6b2692e523/users/3f1875b5d8924eb29720e07e784fdd82/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.373810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2809bba-aea8-4b8e-b278-fda28139b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.374520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2809bba-aea8-4b8e-b278-fda28139b9ad admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.374802 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2809bba-aea8-4b8e-b278-fda28139b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.375076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2809bba-aea8-4b8e-b278-fda28139b9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.375808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2809bba-aea8-4b8e-b278-fda28139b9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.377539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2809bba-aea8-4b8e-b278-fda28139b9ad admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.386199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146343ef-ccf5-4885-a0b1-55367e44e053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc93255837e4cea8443fe6b2692e523, user_id=3f1875b5d8924eb29720e07e784fdd82, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.387692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 801/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.388905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60792881-1aa6-46a7-bedb-f67d477882f3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.389016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146343ef-ccf5-4885-a0b1-55367e44e053 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.389196 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60792881-1aa6-46a7-bedb-f67d477882f3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.389475 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60792881-1aa6-46a7-bedb-f67d477882f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.405256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 796/1597] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:14 2022] PUT /identity/v3/projects/ccc93255837e4cea8443fe6b2692e523/users/3f1875b5d8924eb29720e07e784fdd82/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:14.405858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146343ef-ccf5-4885-a0b1-55367e44e053 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.413139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-60792881-1aa6-46a7-bedb-f67d477882f3 None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:14.414407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-60792881-1aa6-46a7-bedb-f67d477882f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:14.448504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:14.469267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:14.471786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146343ef-ccf5-4885-a0b1-55367e44e053 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.477161 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8cf80-af0f-45df-95dd-2be800660994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.477846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8cf80-af0f-45df-95dd-2be800660994 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.478130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8cf80-af0f-45df-95dd-2be800660994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.478436 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8cf80-af0f-45df-95dd-2be800660994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.479173 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8cf80-af0f-45df-95dd-2be800660994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.480779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8cf80-af0f-45df-95dd-2be800660994 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.483863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 802/1598] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Jun 28 03:17:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:14.484452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60792881-1aa6-46a7-bedb-f67d477882f3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.492240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 797/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.492970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8cf80-af0f-45df-95dd-2be800660994 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.495031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60792881-1aa6-46a7-bedb-f67d477882f3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.499554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001c48-2503-42f8-851b-d992acfe028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.500227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001c48-2503-42f8-851b-d992acfe028d admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.500510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001c48-2503-42f8-851b-d992acfe028d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.500787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001c48-2503-42f8-851b-d992acfe028d admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.501515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42001c48-2503-42f8-851b-d992acfe028d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.502526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8cf80-af0f-45df-95dd-2be800660994 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.503329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42001c48-2503-42f8-851b-d992acfe028d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.507347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecacc67-179a-4e99-b97a-0084a7c07dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.508004 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecacc67-179a-4e99-b97a-0084a7c07dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.508281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecacc67-179a-4e99-b97a-0084a7c07dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.509007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecacc67-179a-4e99-b97a-0084a7c07dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.509769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecacc67-179a-4e99-b97a-0084a7c07dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.511418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecacc67-179a-4e99-b97a-0084a7c07dfe admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.513558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 803/1600] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.514130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001c48-2503-42f8-851b-d992acfe028d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.525260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 798/1601] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:14.525260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81775f-2128-4d7f-bdf8-dd7c326c9dec None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.525260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81775f-2128-4d7f-bdf8-dd7c326c9dec None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.525260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81775f-2128-4d7f-bdf8-dd7c326c9dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.526261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001c48-2503-42f8-851b-d992acfe028d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.530740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204044a9-9c0c-492d-afc7-aa98fa9a584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.531623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204044a9-9c0c-492d-afc7-aa98fa9a584f admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.531904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204044a9-9c0c-492d-afc7-aa98fa9a584f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.532175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204044a9-9c0c-492d-afc7-aa98fa9a584f admin admin] PATH_INFO: `/v3/projects/53f458cbd05549a6907c6c10c03f188f/users/d8733e916d634c0a967ba35261e0c3ec/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.546513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204044a9-9c0c-492d-afc7-aa98fa9a584f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f458cbd05549a6907c6c10c03f188f, user_id=d8733e916d634c0a967ba35261e0c3ec, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.549541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204044a9-9c0c-492d-afc7-aa98fa9a584f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.550807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-bb81775f-2128-4d7f-bdf8-dd7c326c9dec None None] MFA Rules not processed for user `db3affb5714e4cf5a0220866a61e8c69`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:14.552064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bb81775f-2128-4d7f-bdf8-dd7c326c9dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:14.566876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 804/1602] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:14 2022] PUT /identity/v3/projects/53f458cbd05549a6907c6c10c03f188f/users/d8733e916d634c0a967ba35261e0c3ec/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:14.567800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204044a9-9c0c-492d-afc7-aa98fa9a584f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.624928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 799/1603] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:14.626017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b5bd-87ad-46b9-ae5e-d8718fd265c9 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.626445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b5bd-87ad-46b9-ae5e-d8718fd265c9 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.626725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b5bd-87ad-46b9-ae5e-d8718fd265c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.634272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204044a9-9c0c-492d-afc7-aa98fa9a584f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.639148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9ba8f-ffe4-42a9-bf52-8bc8508f850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.640248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9ba8f-ffe4-42a9-bf52-8bc8508f850f admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.640690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9ba8f-ffe4-42a9-bf52-8bc8508f850f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.641550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9ba8f-ffe4-42a9-bf52-8bc8508f850f admin admin] PATH_INFO: `/v3/projects/b5444dedbc2b4f0fa58947297b045cf4/users/8dcd7505602f4b8d95b069374832c9eb/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.645192 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-20a3b5bd-87ad-46b9-ae5e-d8718fd265c9 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:14.645911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-20a3b5bd-87ad-46b9-ae5e-d8718fd265c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:14.657269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 800/1604] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:14.657269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3b5bd-87ad-46b9-ae5e-d8718fd265c9 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.662045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9ba8f-ffe4-42a9-bf52-8bc8508f850f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5444dedbc2b4f0fa58947297b045cf4, user_id=8dcd7505602f4b8d95b069374832c9eb, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.665923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9ba8f-ffe4-42a9-bf52-8bc8508f850f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.679698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 805/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:14 2022] PUT /identity/v3/projects/b5444dedbc2b4f0fa58947297b045cf4/users/8dcd7505602f4b8d95b069374832c9eb/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:14.686436 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9ba8f-ffe4-42a9-bf52-8bc8508f850f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.732297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3b5bd-87ad-46b9-ae5e-d8718fd265c9 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.750180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9ba8f-ffe4-42a9-bf52-8bc8508f850f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.754744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f58ec-3675-45d2-aa3f-2a0f972501d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.755655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f58ec-3675-45d2-aa3f-2a0f972501d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.755931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f58ec-3675-45d2-aa3f-2a0f972501d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.756205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f58ec-3675-45d2-aa3f-2a0f972501d5 admin admin] PATH_INFO: `/v3/projects/eea36b6c2ea44881b5c69b4c70856918/users/f9289bb21ac841c6a64208aad2c4d7b1/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.771040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f58ec-3675-45d2-aa3f-2a0f972501d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea36b6c2ea44881b5c69b4c70856918, user_id=f9289bb21ac841c6a64208aad2c4d7b1, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.773718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f58ec-3675-45d2-aa3f-2a0f972501d5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.775350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:14.788031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 806/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:14 2022] PUT /identity/v3/projects/eea36b6c2ea44881b5c69b4c70856918/users/f9289bb21ac841c6a64208aad2c4d7b1/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:14.788808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f58ec-3675-45d2-aa3f-2a0f972501d5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.808615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bcb06-9867-4829-9aea-a51a0f31d604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.809250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bcb06-9867-4829-9aea-a51a0f31d604 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.809562 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bcb06-9867-4829-9aea-a51a0f31d604 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.809811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bcb06-9867-4829-9aea-a51a0f31d604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.819024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:14.853692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f58ec-3675-45d2-aa3f-2a0f972501d5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.858213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa368714-2428-4289-933f-13e9fd0f3966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.859147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368714-2428-4289-933f-13e9fd0f3966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.859422 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368714-2428-4289-933f-13e9fd0f3966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.859759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368714-2428-4289-933f-13e9fd0f3966 admin admin] PATH_INFO: `/v3/projects/a404fca0ee9d4910b63e8eec7352d36c/users/72f981c1a18d4460b7400036bb5d2e31/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.871347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bcb06-9867-4829-9aea-a51a0f31d604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.873191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bcb06-9867-4829-9aea-a51a0f31d604 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.876559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa368714-2428-4289-933f-13e9fd0f3966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a404fca0ee9d4910b63e8eec7352d36c, user_id=72f981c1a18d4460b7400036bb5d2e31, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.879502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa368714-2428-4289-933f-13e9fd0f3966 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.883759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 801/1607] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:14.884702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bcb06-9867-4829-9aea-a51a0f31d604 service nova] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:14.894147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 807/1608] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:14 2022] PUT /identity/v3/projects/a404fca0ee9d4910b63e8eec7352d36c/users/72f981c1a18d4460b7400036bb5d2e31/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:14.895628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd2ed-36c9-413c-897d-51dba35f5bb3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.895934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd2ed-36c9-413c-897d-51dba35f5bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.896207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd2ed-36c9-413c-897d-51dba35f5bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.899167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bcb06-9867-4829-9aea-a51a0f31d604 service nova] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:14.914555 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-335bd2ed-36c9-413c-897d-51dba35f5bb3 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:14.916005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-335bd2ed-36c9-413c-897d-51dba35f5bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:14.961413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4ac38-97a0-41e9-ae0a-8a833569716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:14.962744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4ac38-97a0-41e9-ae0a-8a833569716f admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.963104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4ac38-97a0-41e9-ae0a-8a833569716f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.963565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4ac38-97a0-41e9-ae0a-8a833569716f admin admin] PATH_INFO: `/v3/projects/dd229ab2591a4bb9a7550617d803e741/users/1dd219b5b23c454c8279169367d23e6e/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.979558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4ac38-97a0-41e9-ae0a-8a833569716f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd229ab2591a4bb9a7550617d803e741, user_id=1dd219b5b23c454c8279169367d23e6e, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:14.980551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 808/1609] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:14.982690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4ac38-97a0-41e9-ae0a-8a833569716f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:14.984826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a2faf-1876-40ac-ae37-a623ee98e5ed None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:14.985155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a2faf-1876-40ac-ae37-a623ee98e5ed None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:14.985363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a2faf-1876-40ac-ae37-a623ee98e5ed None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:14.987586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 809/1610] 10.222.0.23 () {54 vars in 961 bytes} [Tue Jun 28 03:17:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:17:14.988387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a2faf-1876-40ac-ae37-a623ee98e5ed None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.001558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 802/1611] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:14 2022] PUT /identity/v3/projects/dd229ab2591a4bb9a7550617d803e741/users/1dd219b5b23c454c8279169367d23e6e/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:15.007090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478209f0-61ec-4795-b6bd-f3989f05353f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.007381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478209f0-61ec-4795-b6bd-f3989f05353f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.007774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478209f0-61ec-4795-b6bd-f3989f05353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.035538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-478209f0-61ec-4795-b6bd-f3989f05353f None None] MFA Rules not processed for user `8dcd7505602f4b8d95b069374832c9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:15.036855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-478209f0-61ec-4795-b6bd-f3989f05353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:15.049146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a2faf-1876-40ac-ae37-a623ee98e5ed None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.095747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:15.108499 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 803/1612] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:15.109587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5d8b-02c6-47b0-bafe-0cc16c69a252 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.109875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5d8b-02c6-47b0-bafe-0cc16c69a252 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.110151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5d8b-02c6-47b0-bafe-0cc16c69a252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.116017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4107e-89a9-4b35-aa4f-8050ffc22a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.117155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4107e-89a9-4b35-aa4f-8050ffc22a49 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.117658 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4107e-89a9-4b35-aa4f-8050ffc22a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.118000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4107e-89a9-4b35-aa4f-8050ffc22a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.137883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:15.138867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-c61b5d8b-02c6-47b0-bafe-0cc16c69a252 None None] MFA Rules not processed for user `f9289bb21ac841c6a64208aad2c4d7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:15.140072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c61b5d8b-02c6-47b0-bafe-0cc16c69a252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:15.181136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4107e-89a9-4b35-aa4f-8050ffc22a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.182725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4107e-89a9-4b35-aa4f-8050ffc22a49 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:15.193193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 810/1613] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:15.194569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d6d0-f614-4d14-9167-376167a2beb0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.194854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d6d0-f614-4d14-9167-376167a2beb0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.195126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d6d0-f614-4d14-9167-376167a2beb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.205988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 804/1614] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:15.207741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce180e3-1908-4ad3-bb9d-80cd66eec131 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.208243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce180e3-1908-4ad3-bb9d-80cd66eec131 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.209485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce180e3-1908-4ad3-bb9d-80cd66eec131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.213965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-53a5d6d0-f614-4d14-9167-376167a2beb0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:15.215200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-53a5d6d0-f614-4d14-9167-376167a2beb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:15.223904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 811/1615] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:15.224725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d6d0-f614-4d14-9167-376167a2beb0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.234631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-fce180e3-1908-4ad3-bb9d-80cd66eec131 None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:15.235148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d6d0-f614-4d14-9167-376167a2beb0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.235807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fce180e3-1908-4ad3-bb9d-80cd66eec131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:15.239287 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b8385-15d0-4965-8b24-c7fd6edb22e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.239946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b8385-15d0-4965-8b24-c7fd6edb22e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.240226 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b8385-15d0-4965-8b24-c7fd6edb22e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.240502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b8385-15d0-4965-8b24-c7fd6edb22e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.250437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b8385-15d0-4965-8b24-c7fd6edb22e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.251891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b8385-15d0-4965-8b24-c7fd6edb22e4 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:15.262976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 812/1616] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:15.264770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71021-bccb-4d26-bc9d-56ce50ef4adc None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.265289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71021-bccb-4d26-bc9d-56ce50ef4adc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.265567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71021-bccb-4d26-bc9d-56ce50ef4adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.290652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1ad71021-bccb-4d26-bc9d-56ce50ef4adc None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:15.292087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1ad71021-bccb-4d26-bc9d-56ce50ef4adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:15.301241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 813/1617] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:15.303155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556865-0d9e-46d0-9eb1-aa9fa0be0853 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.303513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556865-0d9e-46d0-9eb1-aa9fa0be0853 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.303858 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556865-0d9e-46d0-9eb1-aa9fa0be0853 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.305657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 814/1618] 10.222.0.23 () {54 vars in 912 bytes} [Tue Jun 28 03:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:17:15.306535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0556865-0d9e-46d0-9eb1-aa9fa0be0853 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.322240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0556865-0d9e-46d0-9eb1-aa9fa0be0853 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.325713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 805/1619] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Jun 28 03:17:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:15.326634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce180e3-1908-4ad3-bb9d-80cd66eec131 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.326881 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ae3fa-80d1-4115-a30b-b38f58490535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.327616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae3fa-80d1-4115-a30b-b38f58490535 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.327903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae3fa-80d1-4115-a30b-b38f58490535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.328180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae3fa-80d1-4115-a30b-b38f58490535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.328881 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ae3fa-80d1-4115-a30b-b38f58490535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.330917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ae3fa-80d1-4115-a30b-b38f58490535 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:15.337377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce180e3-1908-4ad3-bb9d-80cd66eec131 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.341081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc0cf1-eb09-4261-a880-1453e23b5f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.341805 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc0cf1-eb09-4261-a880-1453e23b5f33 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.342150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc0cf1-eb09-4261-a880-1453e23b5f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.342507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc0cf1-eb09-4261-a880-1453e23b5f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.353863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc0cf1-eb09-4261-a880-1453e23b5f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.355900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc0cf1-eb09-4261-a880-1453e23b5f33 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:15.364311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 815/1620] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:15 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:15.366030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55004136-da8a-4555-8fcc-b4fcfbe01819 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.366353 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55004136-da8a-4555-8fcc-b4fcfbe01819 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.366715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55004136-da8a-4555-8fcc-b4fcfbe01819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.380766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 806/1621] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:15.381581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc0cf1-eb09-4261-a880-1453e23b5f33 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.389842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-55004136-da8a-4555-8fcc-b4fcfbe01819 None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:15.391480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-55004136-da8a-4555-8fcc-b4fcfbe01819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:15.398485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc0cf1-eb09-4261-a880-1453e23b5f33 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.466937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704d75b-f5cc-4cd4-b395-31562f81438c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.467697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704d75b-f5cc-4cd4-b395-31562f81438c service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.468051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704d75b-f5cc-4cd4-b395-31562f81438c service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.468398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704d75b-f5cc-4cd4-b395-31562f81438c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.491557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:15.512518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 816/1622] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:17:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:15.514779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55004136-da8a-4555-8fcc-b4fcfbe01819 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.553676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55004136-da8a-4555-8fcc-b4fcfbe01819 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.570077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d319004-33f2-43bb-938c-5f640b6998df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.571000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d319004-33f2-43bb-938c-5f640b6998df service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.571356 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d319004-33f2-43bb-938c-5f640b6998df service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.571701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d319004-33f2-43bb-938c-5f640b6998df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.573452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704d75b-f5cc-4cd4-b395-31562f81438c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.575631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704d75b-f5cc-4cd4-b395-31562f81438c service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:15.590310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 807/1623] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:15.591258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704d75b-f5cc-4cd4-b395-31562f81438c service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.602920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704d75b-f5cc-4cd4-b395-31562f81438c service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.608950 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f75df-b149-488b-abd5-fa5700b9ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.610178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f75df-b149-488b-abd5-fa5700b9ee54 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.610675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f75df-b149-488b-abd5-fa5700b9ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.611007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f75df-b149-488b-abd5-fa5700b9ee54 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.611882 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f75df-b149-488b-abd5-fa5700b9ee54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.614027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f75df-b149-488b-abd5-fa5700b9ee54 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:15.646311 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 808/1624] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:15 2022] POST /identity/v3/users => generated 297 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:15.647616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f75df-b149-488b-abd5-fa5700b9ee54 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.684925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d319004-33f2-43bb-938c-5f640b6998df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.687936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d319004-33f2-43bb-938c-5f640b6998df service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:15.694861 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:15.709510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 817/1625] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:15.711008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d319004-33f2-43bb-938c-5f640b6998df service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.731501 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d319004-33f2-43bb-938c-5f640b6998df service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.735575 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f75df-b149-488b-abd5-fa5700b9ee54 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.740137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af0d09-49b7-408e-90b0-9923a7785b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.741141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af0d09-49b7-408e-90b0-9923a7785b84 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.741577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af0d09-49b7-408e-90b0-9923a7785b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.742002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af0d09-49b7-408e-90b0-9923a7785b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.742569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad7311-94ba-4f41-b379-af0492cd05a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.743563 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad7311-94ba-4f41-b379-af0492cd05a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.744073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad7311-94ba-4f41-b379-af0492cd05a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.744544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad7311-94ba-4f41-b379-af0492cd05a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.746028 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad7311-94ba-4f41-b379-af0492cd05a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.748180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad7311-94ba-4f41-b379-af0492cd05a0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:15.755999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af0d09-49b7-408e-90b0-9923a7785b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.757616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af0d09-49b7-408e-90b0-9923a7785b84 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:15.766995 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 818/1626] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:15.768856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad7311-94ba-4f41-b379-af0492cd05a0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.779336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 809/1627] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:15.783197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad7311-94ba-4f41-b379-af0492cd05a0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.789861 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c968d2-1c96-4d23-b309-b81973165849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.790927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c968d2-1c96-4d23-b309-b81973165849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.791471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c968d2-1c96-4d23-b309-b81973165849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.791857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c968d2-1c96-4d23-b309-b81973165849 admin admin] PATH_INFO: `/v3/projects/461b157d8b2b4bc19ff45bdf23d985c6/users/cd127f8e2eb34b5f923c7340e011c080/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.810381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c968d2-1c96-4d23-b309-b81973165849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461b157d8b2b4bc19ff45bdf23d985c6, user_id=cd127f8e2eb34b5f923c7340e011c080, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.813893 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c968d2-1c96-4d23-b309-b81973165849 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:15.833128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 819/1628] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:15 2022] PUT /identity/v3/projects/461b157d8b2b4bc19ff45bdf23d985c6/users/cd127f8e2eb34b5f923c7340e011c080/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:15.837462 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af0d09-49b7-408e-90b0-9923a7785b84 service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.854000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af0d09-49b7-408e-90b0-9923a7785b84 service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.935410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7459a4-0ae8-4f3f-9032-c017d4af9946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.936190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7459a4-0ae8-4f3f-9032-c017d4af9946 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.936608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7459a4-0ae8-4f3f-9032-c017d4af9946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.936892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7459a4-0ae8-4f3f-9032-c017d4af9946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.937916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7459a4-0ae8-4f3f-9032-c017d4af9946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.939932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7459a4-0ae8-4f3f-9032-c017d4af9946 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:15.954939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 810/1629] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:15.960257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c968d2-1c96-4d23-b309-b81973165849 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:15.974909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c968d2-1c96-4d23-b309-b81973165849 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:15.981130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc9090-2339-4fa1-b1f7-9a97482c34d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:15.982182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9090-2339-4fa1-b1f7-9a97482c34d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:15.982514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9090-2339-4fa1-b1f7-9a97482c34d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:15.983305 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9090-2339-4fa1-b1f7-9a97482c34d9 admin admin] PATH_INFO: `/v3/projects/461b157d8b2b4bc19ff45bdf23d985c6/users/cd127f8e2eb34b5f923c7340e011c080/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:15.985635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc9090-2339-4fa1-b1f7-9a97482c34d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461b157d8b2b4bc19ff45bdf23d985c6, user_id=cd127f8e2eb34b5f923c7340e011c080, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:15.988774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc9090-2339-4fa1-b1f7-9a97482c34d9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:16.018330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3f5b-818e-4d13-862b-bbb14c0d4681 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:16.018697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3f5b-818e-4d13-862b-bbb14c0d4681 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:16.019030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3f5b-818e-4d13-862b-bbb14c0d4681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:16.020514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 820/1630] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:15 2022] PUT /identity/v3/projects/461b157d8b2b4bc19ff45bdf23d985c6/users/cd127f8e2eb34b5f923c7340e011c080/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:16.056481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-bf7d3f5b-818e-4d13-862b-bbb14c0d4681 None None] MFA Rules not processed for user `cd127f8e2eb34b5f923c7340e011c080`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:16.061308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bf7d3f5b-818e-4d13-862b-bbb14c0d4681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:16.086323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:16.178068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc9090-2339-4fa1-b1f7-9a97482c34d9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:16.207413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 811/1631] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:16.220723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d3f5b-818e-4d13-862b-bbb14c0d4681 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:16.319685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc9090-2339-4fa1-b1f7-9a97482c34d9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:16.328641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc67b26-8571-40ab-af34-5eb6ea701dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:16.329718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc67b26-8571-40ab-af34-5eb6ea701dff service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:16.329948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc67b26-8571-40ab-af34-5eb6ea701dff service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:16.330877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc67b26-8571-40ab-af34-5eb6ea701dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:16.341134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d3f5b-818e-4d13-862b-bbb14c0d4681 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:16.349402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c2ff6-53a6-4262-b821-9d38a9b7c9f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:16.351237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c2ff6-53a6-4262-b821-9d38a9b7c9f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:16.352525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c2ff6-53a6-4262-b821-9d38a9b7c9f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:16.353012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c2ff6-53a6-4262-b821-9d38a9b7c9f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:16.368575 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c2ff6-53a6-4262-b821-9d38a9b7c9f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:16.371367 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c2ff6-53a6-4262-b821-9d38a9b7c9f7 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:16.383635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 812/1632] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:17:16.453865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc67b26-8571-40ab-af34-5eb6ea701dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:16.456135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc67b26-8571-40ab-af34-5eb6ea701dff service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:16.481284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 821/1633] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:16.543307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd13af-2647-471a-811e-d30ccbd9de08 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:16.543601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd13af-2647-471a-811e-d30ccbd9de08 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:16.543881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd13af-2647-471a-811e-d30ccbd9de08 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:16.545365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 813/1634] 10.222.0.23 () {54 vars in 912 bytes} [Tue Jun 28 03:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:17:16.575343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f673-dbad-457c-9b15-d22c57570ac0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:16.575630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f673-dbad-457c-9b15-d22c57570ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:16.576109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f673-dbad-457c-9b15-d22c57570ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:16.594546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd13af-2647-471a-811e-d30ccbd9de08 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:16.614940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd13af-2647-471a-811e-d30ccbd9de08 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:16.621202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3448f673-dbad-457c-9b15-d22c57570ac0 None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:16.624013 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6debe-fa08-4d84-af84-ac90ffd0f01b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:16.624677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6debe-fa08-4d84-af84-ac90ffd0f01b service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:16.624998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6debe-fa08-4d84-af84-ac90ffd0f01b service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:16.625256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6debe-fa08-4d84-af84-ac90ffd0f01b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:16.626388 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3448f673-dbad-457c-9b15-d22c57570ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:16.648818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 822/1635] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:17:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:16.777156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6debe-fa08-4d84-af84-ac90ffd0f01b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:16.780714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6debe-fa08-4d84-af84-ac90ffd0f01b service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:16.782480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448f673-dbad-457c-9b15-d22c57570ac0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:16.796405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448f673-dbad-457c-9b15-d22c57570ac0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:16.813499 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2479c-6435-4d55-9a5c-33633d34edc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:16.827440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 814/1636] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:16.831026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2479c-6435-4d55-9a5c-33633d34edc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:16.831317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2479c-6435-4d55-9a5c-33633d34edc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:16.831595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2479c-6435-4d55-9a5c-33633d34edc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:16.860669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2479c-6435-4d55-9a5c-33633d34edc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:16.862217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2479c-6435-4d55-9a5c-33633d34edc3 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:16.889027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 823/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:17:17.803848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6debe-fa08-4d84-af84-ac90ffd0f01b service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:17.946822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6debe-fa08-4d84-af84-ac90ffd0f01b service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:17.952309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:17.953535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:17.953535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:17.953896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] PATH_INFO: `/v3/users/db3affb5714e4cf5a0220866a61e8c69` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:17.956571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3affb5714e4cf5a0220866a61e8c69)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:17.959255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:17.962102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:18.072218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3affb5714e4cf5a0220866a61e8c69'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:18.073144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3affb5714e4cf5a0220866a61e8c69'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:18.092862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3affb5714e4cf5a0220866a61e8c69'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:18.108979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3affb5714e4cf5a0220866a61e8c69'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:18.130894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3affb5714e4cf5a0220866a61e8c69'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:18.147642 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 815/1638] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:17 2022] DELETE /identity/v3/users/db3affb5714e4cf5a0220866a61e8c69 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:18.149382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f6b8b-090e-4071-b039-46ecb84c676a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:18.149895 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f6b8b-090e-4071-b039-46ecb84c676a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:18.150264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f6b8b-090e-4071-b039-46ecb84c676a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:18.176456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f87f6b8b-090e-4071-b039-46ecb84c676a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:18.178066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f87f6b8b-090e-4071-b039-46ecb84c676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:18.207080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:18.274178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 824/1639] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:18.287953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:18.291011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:18.381825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf234fd3-c03e-411c-b226-0ddbf92a5534 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:18.389188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dd0cd-4d2e-46d0-a75d-53f90f3b01ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:18.389188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dd0cd-4d2e-46d0-a75d-53f90f3b01ac service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:18.389188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dd0cd-4d2e-46d0-a75d-53f90f3b01ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:18.389188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dd0cd-4d2e-46d0-a75d-53f90f3b01ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:18.401156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1dd0cd-4d2e-46d0-a75d-53f90f3b01ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:18.404348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1dd0cd-4d2e-46d0-a75d-53f90f3b01ac service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:18.420865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 816/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:17:19.674771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f6b8b-090e-4071-b039-46ecb84c676a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:19.677959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f87f6b8b-090e-4071-b039-46ecb84c676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:19.730172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f6b8b-090e-4071-b039-46ecb84c676a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:19.747256 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:19.748419 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:19.749491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:19.751387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] PATH_INFO: `/v3/projects/99b37f6e28d847c5beabb543147d3310` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:19.757907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b37f6e28d847c5beabb543147d3310)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:19.766034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:19.880611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b37f6e28d847c5beabb543147d3310', 'request_id': 'req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:19.890078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b37f6e28d847c5beabb543147d3310', 'request_id': 'req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:19.903121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b37f6e28d847c5beabb543147d3310', 'request_id': 'req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:19.930337 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] The token cache is being invalidate because project 99b37f6e28d847c5beabb543147d3310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:19.931341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:19.932521 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c7a77446-9c8a-4ec1-8e7b-96747d0667b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:19.942467 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 825/1641] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:19 2022] DELETE /identity/v3/projects/99b37f6e28d847c5beabb543147d3310 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:19.945894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3109159-d9eb-4388-90e9-168e10b09c77 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:19.946827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3109159-d9eb-4388-90e9-168e10b09c77 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:19.947278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3109159-d9eb-4388-90e9-168e10b09c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:19.998698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f3109159-d9eb-4388-90e9-168e10b09c77 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:19.998698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f3109159-d9eb-4388-90e9-168e10b09c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:20.240309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571fe58-0a33-4dd5-9deb-5d2fca429b6e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:20.240704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571fe58-0a33-4dd5-9deb-5d2fca429b6e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:20.241091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571fe58-0a33-4dd5-9deb-5d2fca429b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:20.257813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 817/1642] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:20.259342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3109159-d9eb-4388-90e9-168e10b09c77 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:20.261789 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f3109159-d9eb-4388-90e9-168e10b09c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:20.273635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8571fe58-0a33-4dd5-9deb-5d2fca429b6e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:20.279606 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8571fe58-0a33-4dd5-9deb-5d2fca429b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:20.306735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 826/1643] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:20.308088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571fe58-0a33-4dd5-9deb-5d2fca429b6e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:20.309646 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3109159-d9eb-4388-90e9-168e10b09c77 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:20.316116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208295e1-230b-4a77-a8f2-03f6c7295454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:20.317092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208295e1-230b-4a77-a8f2-03f6c7295454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:20.317375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208295e1-230b-4a77-a8f2-03f6c7295454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:20.317649 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208295e1-230b-4a77-a8f2-03f6c7295454 admin admin] PATH_INFO: `/v3/users/699673c30c364a68a61e4887c25021d1` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:20.319381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208295e1-230b-4a77-a8f2-03f6c7295454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=699673c30c364a68a61e4887c25021d1)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:20.321913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208295e1-230b-4a77-a8f2-03f6c7295454 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:20.335904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571fe58-0a33-4dd5-9deb-5d2fca429b6e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:20.346002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:20.352231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3442b18-6968-4aa5-ae57-8f5a7cc8b9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:20.353229 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3442b18-6968-4aa5-ae57-8f5a7cc8b9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:20.353715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3442b18-6968-4aa5-ae57-8f5a7cc8b9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:20.354213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3442b18-6968-4aa5-ae57-8f5a7cc8b9f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:20.355186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3442b18-6968-4aa5-ae57-8f5a7cc8b9f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:20.355694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3442b18-6968-4aa5-ae57-8f5a7cc8b9f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:20.357662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3442b18-6968-4aa5-ae57-8f5a7cc8b9f5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:20.377949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 827/1644] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:20.379318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3442b18-6968-4aa5-ae57-8f5a7cc8b9f5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:20.391262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3442b18-6968-4aa5-ae57-8f5a7cc8b9f5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:20.403793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39880a-9682-4789-a960-b6431456c141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:20.404865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39880a-9682-4789-a960-b6431456c141 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:20.405350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39880a-9682-4789-a960-b6431456c141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:20.405823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39880a-9682-4789-a960-b6431456c141 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:20.406771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39880a-9682-4789-a960-b6431456c141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:20.409069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-208295e1-230b-4a77-a8f2-03f6c7295454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699673c30c364a68a61e4887c25021d1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:20.409812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-208295e1-230b-4a77-a8f2-03f6c7295454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699673c30c364a68a61e4887c25021d1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:20.410843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39880a-9682-4789-a960-b6431456c141 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:20.425170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-208295e1-230b-4a77-a8f2-03f6c7295454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699673c30c364a68a61e4887c25021d1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:20.445179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-208295e1-230b-4a77-a8f2-03f6c7295454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699673c30c364a68a61e4887c25021d1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:20.473178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 828/1645] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:20 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:20.474558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39880a-9682-4789-a960-b6431456c141 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:20.480056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-208295e1-230b-4a77-a8f2-03f6c7295454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699673c30c364a68a61e4887c25021d1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:20.498409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 818/1646] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:20 2022] DELETE /identity/v3/users/699673c30c364a68a61e4887c25021d1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:20.500071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f47ac2-94c9-4513-ab1c-61e83b7cd9b4 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:20.500377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f47ac2-94c9-4513-ab1c-61e83b7cd9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:20.500655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f47ac2-94c9-4513-ab1c-61e83b7cd9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:20.543281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-23f47ac2-94c9-4513-ab1c-61e83b7cd9b4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:20.544519 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-23f47ac2-94c9-4513-ab1c-61e83b7cd9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:20.627205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39880a-9682-4789-a960-b6431456c141 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:20.657433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:20.685441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 819/1647] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:20.772701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd4cff-79cc-47f7-aacf-d12e7c62cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:20.773957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd4cff-79cc-47f7-aacf-d12e7c62cb71 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:20.774399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd4cff-79cc-47f7-aacf-d12e7c62cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:20.774804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd4cff-79cc-47f7-aacf-d12e7c62cb71 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:20.775818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd4cff-79cc-47f7-aacf-d12e7c62cb71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:20.777970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd4cff-79cc-47f7-aacf-d12e7c62cb71 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:20.822913 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 829/1648] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:20 2022] POST /identity/v3/users => generated 283 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:20.826911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f47ac2-94c9-4513-ab1c-61e83b7cd9b4 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:20.828375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-23f47ac2-94c9-4513-ab1c-61e83b7cd9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:20.862012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f47ac2-94c9-4513-ab1c-61e83b7cd9b4 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:20.876239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36986a-719d-4ec5-8c4c-c136d03a0630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:20.877157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36986a-719d-4ec5-8c4c-c136d03a0630 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:20.877484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36986a-719d-4ec5-8c4c-c136d03a0630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:20.877938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36986a-719d-4ec5-8c4c-c136d03a0630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:20.882872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36986a-719d-4ec5-8c4c-c136d03a0630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:20.884721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36986a-719d-4ec5-8c4c-c136d03a0630 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:20.899303 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd4cff-79cc-47f7-aacf-d12e7c62cb71 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:20.902564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cbdd4cff-79cc-47f7-aacf-d12e7c62cb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:20.909428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 820/1649] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:20.911673 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36986a-719d-4ec5-8c4c-c136d03a0630 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:20.937487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36986a-719d-4ec5-8c4c-c136d03a0630 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:20.952121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408cb58-d394-4561-8764-f9fdba708ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:20.952859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408cb58-d394-4561-8764-f9fdba708ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:20.953140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408cb58-d394-4561-8764-f9fdba708ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:20.953411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408cb58-d394-4561-8764-f9fdba708ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:20.954344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408cb58-d394-4561-8764-f9fdba708ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:20.958641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408cb58-d394-4561-8764-f9fdba708ba2 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:20.989277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 821/1650] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:20.991239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408cb58-d394-4561-8764-f9fdba708ba2 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:21.019000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408cb58-d394-4561-8764-f9fdba708ba2 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:21.028393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd4cff-79cc-47f7-aacf-d12e7c62cb71 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:21.032590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca5cd8-578b-424a-b309-a25899ce9a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:21.033529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca5cd8-578b-424a-b309-a25899ce9a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:21.033964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade9265-da58-4d14-9d52-18c1289f9713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:21.034585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca5cd8-578b-424a-b309-a25899ce9a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:21.034968 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca5cd8-578b-424a-b309-a25899ce9a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:21.035368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade9265-da58-4d14-9d52-18c1289f9713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:21.035772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade9265-da58-4d14-9d52-18c1289f9713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:21.036168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade9265-da58-4d14-9d52-18c1289f9713 admin admin] PATH_INFO: `/v3/projects/f2f1f397be9f48ab96650dc6bb9ded5a/users/9a0b04c79ae344f5a28da82b6cf08631/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:21.046897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca5cd8-578b-424a-b309-a25899ce9a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:21.048931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca5cd8-578b-424a-b309-a25899ce9a60 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:21.061626 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 830/1651] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:17:21.094189 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade9265-da58-4d14-9d52-18c1289f9713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f1f397be9f48ab96650dc6bb9ded5a, user_id=9a0b04c79ae344f5a28da82b6cf08631, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:21.095012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade9265-da58-4d14-9d52-18c1289f9713 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:21.144735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 822/1652] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:20 2022] PUT /identity/v3/projects/f2f1f397be9f48ab96650dc6bb9ded5a/users/9a0b04c79ae344f5a28da82b6cf08631/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:21.156116 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572859d-2865-46a2-a1c6-9431a33b45dc None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:21.156526 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572859d-2865-46a2-a1c6-9431a33b45dc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:21.156906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572859d-2865-46a2-a1c6-9431a33b45dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:21.244205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9572859d-2865-46a2-a1c6-9431a33b45dc None None] MFA Rules not processed for user `9a0b04c79ae344f5a28da82b6cf08631`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:21.249130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9572859d-2865-46a2-a1c6-9431a33b45dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:21.428150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 831/1653] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:21.433657 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade9265-da58-4d14-9d52-18c1289f9713 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:21.555236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:21.589494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade9265-da58-4d14-9d52-18c1289f9713 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:21.597023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e7168-bfef-4662-bc36-f700a1434fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:21.597934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e7168-bfef-4662-bc36-f700a1434fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:21.598452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e7168-bfef-4662-bc36-f700a1434fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:21.598867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e7168-bfef-4662-bc36-f700a1434fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:21.599711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e7168-bfef-4662-bc36-f700a1434fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:21.602200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e7168-bfef-4662-bc36-f700a1434fa8 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:21.680936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 823/1654] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:21 2022] POST /identity/v3/projects => generated 365 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:21.682194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572859d-2865-46a2-a1c6-9431a33b45dc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:21.705188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572859d-2865-46a2-a1c6-9431a33b45dc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:21.790854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:21.855091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f74402-fc77-4a18-84e2-95d40a4d0e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:21.855805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74402-fc77-4a18-84e2-95d40a4d0e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:21.856081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74402-fc77-4a18-84e2-95d40a4d0e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:21.856350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74402-fc77-4a18-84e2-95d40a4d0e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:21.861296 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f74402-fc77-4a18-84e2-95d40a4d0e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:21.864325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f74402-fc77-4a18-84e2-95d40a4d0e56 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:21.911622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 832/1655] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:21 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:21.913535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e7168-bfef-4662-bc36-f700a1434fa8 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:21.928530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e7168-bfef-4662-bc36-f700a1434fa8 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:21.942979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6aeb1b-a648-4e02-8098-9534c36bb43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:21.944382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6aeb1b-a648-4e02-8098-9534c36bb43f admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:21.944382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6aeb1b-a648-4e02-8098-9534c36bb43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:21.945183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6aeb1b-a648-4e02-8098-9534c36bb43f admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:21.945289 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6aeb1b-a648-4e02-8098-9534c36bb43f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:21.951279 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6aeb1b-a648-4e02-8098-9534c36bb43f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:21.988281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 824/1656] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:21.992254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f74402-fc77-4a18-84e2-95d40a4d0e56 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:22.007623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f74402-fc77-4a18-84e2-95d40a4d0e56 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:22.021091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b893ce8-5f66-49e9-abee-56119f9a3c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:22.022102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b893ce8-5f66-49e9-abee-56119f9a3c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:22.022531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b893ce8-5f66-49e9-abee-56119f9a3c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:22.022868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b893ce8-5f66-49e9-abee-56119f9a3c4d admin admin] PATH_INFO: `/v3/projects/20cbee556cac4578b9dd6621fe281634/users/1fc4dd1c91dc4c80ac0a766fd9194c27/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:22.082756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b893ce8-5f66-49e9-abee-56119f9a3c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cbee556cac4578b9dd6621fe281634, user_id=1fc4dd1c91dc4c80ac0a766fd9194c27, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:22.091333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b893ce8-5f66-49e9-abee-56119f9a3c4d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:22.123832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 833/1657] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:21 2022] PUT /identity/v3/projects/20cbee556cac4578b9dd6621fe281634/users/1fc4dd1c91dc4c80ac0a766fd9194c27/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:22.125090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6aeb1b-a648-4e02-8098-9534c36bb43f admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:22.136724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6aeb1b-a648-4e02-8098-9534c36bb43f admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:22.439766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a33cc-0d54-4134-8426-3389f5295c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:22.440610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a33cc-0d54-4134-8426-3389f5295c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:22.442475 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a33cc-0d54-4134-8426-3389f5295c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:22.443034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a33cc-0d54-4134-8426-3389f5295c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:22.445567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a33cc-0d54-4134-8426-3389f5295c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:22.451181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a33cc-0d54-4134-8426-3389f5295c75 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:22.482055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 825/1658] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:22.485569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b893ce8-5f66-49e9-abee-56119f9a3c4d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:22.501491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b893ce8-5f66-49e9-abee-56119f9a3c4d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:22.517067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca11f-dae8-439c-bdca-a6ac2329ac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:22.518206 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca11f-dae8-439c-bdca-a6ac2329ac88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:22.518574 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca11f-dae8-439c-bdca-a6ac2329ac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:22.518910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca11f-dae8-439c-bdca-a6ac2329ac88 admin admin] PATH_INFO: `/v3/projects/20cbee556cac4578b9dd6621fe281634/users/1fc4dd1c91dc4c80ac0a766fd9194c27/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:22.523396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ca11f-dae8-439c-bdca-a6ac2329ac88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cbee556cac4578b9dd6621fe281634, user_id=1fc4dd1c91dc4c80ac0a766fd9194c27, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:22.540511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ca11f-dae8-439c-bdca-a6ac2329ac88 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:22.574630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 834/1659] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:22 2022] PUT /identity/v3/projects/20cbee556cac4578b9dd6621fe281634/users/1fc4dd1c91dc4c80ac0a766fd9194c27/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:22.589077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4b36c-a0ec-4698-8602-ee32bee03add None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:22.590174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4b36c-a0ec-4698-8602-ee32bee03add None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:22.591930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4b36c-a0ec-4698-8602-ee32bee03add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:22.724819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-fdd4b36c-a0ec-4698-8602-ee32bee03add None None] MFA Rules not processed for user `1fc4dd1c91dc4c80ac0a766fd9194c27`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:22.729307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fdd4b36c-a0ec-4698-8602-ee32bee03add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:22.962725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 826/1660] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:22.965831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca11f-dae8-439c-bdca-a6ac2329ac88 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:22.968668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-518ca11f-dae8-439c-bdca-a6ac2329ac88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:23.014568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4b36c-a0ec-4698-8602-ee32bee03add None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:23.016368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fdd4b36c-a0ec-4698-8602-ee32bee03add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:23.161310 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca11f-dae8-439c-bdca-a6ac2329ac88 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:23.168141 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8121db-9848-4595-a747-1051989af514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:23.168888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8121db-9848-4595-a747-1051989af514 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:23.169333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8121db-9848-4595-a747-1051989af514 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:23.169618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8121db-9848-4595-a747-1051989af514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:23.186376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8121db-9848-4595-a747-1051989af514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:23.187933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8121db-9848-4595-a747-1051989af514 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:23.206820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:23.227482 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 835/1661] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:23.312320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4b36c-a0ec-4698-8602-ee32bee03add None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:23.333528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:23.334638 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:23.335138 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:23.335621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] PATH_INFO: `/v3/projects/54a71e62822b47038c55b24dc66f2878` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:23.337788 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a71e62822b47038c55b24dc66f2878)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:23.339078 dv-cinder-846842-5-smb devstack@keystone.service[80342]: WARNING py.warnings [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:17:23.339078 dv-cinder-846842-5-smb devstack@keystone.service[80342]: warnings.warn(msg) Jun 28 03:17:23.339078 dv-cinder-846842-5-smb devstack@keystone.service[80342]: Jun 28 03:17:23.340633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:23.525531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a71e62822b47038c55b24dc66f2878', 'request_id': 'req-4dbc5806-2689-4c3c-be6e-99086846e405'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:23.557260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a71e62822b47038c55b24dc66f2878', 'request_id': 'req-4dbc5806-2689-4c3c-be6e-99086846e405'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:23.594853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a71e62822b47038c55b24dc66f2878', 'request_id': 'req-4dbc5806-2689-4c3c-be6e-99086846e405'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:23.659746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] The token cache is being invalidate because project 54a71e62822b47038c55b24dc66f2878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:23.660033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:23.666041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:23.671115 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 827/1662] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:23 2022] DELETE /identity/v3/projects/54a71e62822b47038c55b24dc66f2878 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:17:23.676272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc8a5-4075-4951-abda-d7d0fc5e60ea None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:23.682529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc8a5-4075-4951-abda-d7d0fc5e60ea None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:23.685315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc8a5-4075-4951-abda-d7d0fc5e60ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:23.751766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-532fc8a5-4075-4951-abda-d7d0fc5e60ea None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:23.757519 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-532fc8a5-4075-4951-abda-d7d0fc5e60ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:23.846799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:23.848488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:23.919690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 836/1663] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:23.929715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c158cac-741d-42ad-afc0-aeee1b223473 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:23.930029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c158cac-741d-42ad-afc0-aeee1b223473 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:23.930489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c158cac-741d-42ad-afc0-aeee1b223473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:23.984965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3c158cac-741d-42ad-afc0-aeee1b223473 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:23.988778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3c158cac-741d-42ad-afc0-aeee1b223473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:24.023671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc5806-2689-4c3c-be6e-99086846e405 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:24.032287 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 837/1664] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:24.036410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:24.037363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:24.037646 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:24.037921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] PATH_INFO: `/v3/users/8dcd7505602f4b8d95b069374832c9eb` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:24.039022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c158cac-741d-42ad-afc0-aeee1b223473 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:24.039255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dcd7505602f4b8d95b069374832c9eb)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:24.041794 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:24.091480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c158cac-741d-42ad-afc0-aeee1b223473 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:24.127146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2f21-e561-4b15-ba4d-d1234e693b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:24.128674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2f21-e561-4b15-ba4d-d1234e693b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:24.129378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2f21-e561-4b15-ba4d-d1234e693b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:24.129789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2f21-e561-4b15-ba4d-d1234e693b1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:24.130733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee2f21-e561-4b15-ba4d-d1234e693b1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:24.134592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee2f21-e561-4b15-ba4d-d1234e693b1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:24.138107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee2f21-e561-4b15-ba4d-d1234e693b1d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:24.192744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 838/1665] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:24.203621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2f21-e561-4b15-ba4d-d1234e693b1d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:24.248160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2f21-e561-4b15-ba4d-d1234e693b1d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:24.253822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dcd7505602f4b8d95b069374832c9eb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:24.257651 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dcd7505602f4b8d95b069374832c9eb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:24.273771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfa6b0-c64d-4f8c-9d14-a809b9bfb359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:24.274484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa6b0-c64d-4f8c-9d14-a809b9bfb359 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:24.274768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa6b0-c64d-4f8c-9d14-a809b9bfb359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:24.275042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa6b0-c64d-4f8c-9d14-a809b9bfb359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:24.275752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfa6b0-c64d-4f8c-9d14-a809b9bfb359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:24.277832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfa6b0-c64d-4f8c-9d14-a809b9bfb359 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:24.281877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dcd7505602f4b8d95b069374832c9eb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:24.303420 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dcd7505602f4b8d95b069374832c9eb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:24.315992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:24.350760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:24.358993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dcd7505602f4b8d95b069374832c9eb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:24.375286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 839/1666] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:24 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:24.379855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 828/1667] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:23 2022] DELETE /identity/v3/users/8dcd7505602f4b8d95b069374832c9eb => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:17:24.381192 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:24.382673 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:24.382787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504c9d9-d9e7-4f1b-b682-06258b33014b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:24.383090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504c9d9-d9e7-4f1b-b682-06258b33014b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:24.383370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504c9d9-d9e7-4f1b-b682-06258b33014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:24.464268 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b504c9d9-d9e7-4f1b-b682-06258b33014b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:24.476779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b504c9d9-d9e7-4f1b-b682-06258b33014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:24.723029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753acbb5-ad26-42ae-a81a-de6f4b47fe93 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:24.745953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0ae0-ff40-4b43-bb85-e7355999a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:24.746615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0ae0-ff40-4b43-bb85-e7355999a0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:24.746901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0ae0-ff40-4b43-bb85-e7355999a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:24.747177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0ae0-ff40-4b43-bb85-e7355999a0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:24.747902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc0ae0-ff40-4b43-bb85-e7355999a0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:24.749865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc0ae0-ff40-4b43-bb85-e7355999a0b9 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:24.828007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 840/1668] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:24.838682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504c9d9-d9e7-4f1b-b682-06258b33014b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:24.849157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b504c9d9-d9e7-4f1b-b682-06258b33014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:24.851794 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 829/1669] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:24 2022] POST /identity/v3/users => generated 283 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:24.859460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0ae0-ff40-4b43-bb85-e7355999a0b9 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:24.896986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0ae0-ff40-4b43-bb85-e7355999a0b9 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:24.906134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504c9d9-d9e7-4f1b-b682-06258b33014b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:24.921608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7fe17-9a26-43f7-906a-890d988621c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:24.922354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7fe17-9a26-43f7-906a-890d988621c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:24.922647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7fe17-9a26-43f7-906a-890d988621c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:24.922921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7fe17-9a26-43f7-906a-890d988621c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:24.923771 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7fe17-9a26-43f7-906a-890d988621c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:24.925121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:24.926061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:24.926380 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:24.926668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] PATH_INFO: `/v3/users/9a0b04c79ae344f5a28da82b6cf08631` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:24.931917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0b04c79ae344f5a28da82b6cf08631)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:24.932171 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7fe17-9a26-43f7-906a-890d988621c9 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:24.932281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: WARNING py.warnings [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:17:24.932281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: warnings.warn(msg) Jun 28 03:17:24.932281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: Jun 28 03:17:24.933394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:24.983013 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 830/1670] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:24.983655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7fe17-9a26-43f7-906a-890d988621c9 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:25.003777 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-86a7fe17-9a26-43f7-906a-890d988621c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:25.159447 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0b04c79ae344f5a28da82b6cf08631'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:25.160428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0b04c79ae344f5a28da82b6cf08631'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:25.178736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0b04c79ae344f5a28da82b6cf08631'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:25.181867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7fe17-9a26-43f7-906a-890d988621c9 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:25.192143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7673e57-1e6a-4f66-b593-c55dd4c9c5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:25.194203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7673e57-1e6a-4f66-b593-c55dd4c9c5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:25.195230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7673e57-1e6a-4f66-b593-c55dd4c9c5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:25.195344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7673e57-1e6a-4f66-b593-c55dd4c9c5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:25.216343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0b04c79ae344f5a28da82b6cf08631'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:25.220855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7673e57-1e6a-4f66-b593-c55dd4c9c5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:25.223389 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7673e57-1e6a-4f66-b593-c55dd4c9c5a6 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:25.241098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-12ac2d97-810d-4bc3-9859-7ebd220274d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0b04c79ae344f5a28da82b6cf08631'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:25.246693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 831/1671] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:25.247378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7673e57-1e6a-4f66-b593-c55dd4c9c5a6 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:25.257628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 841/1672] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:24 2022] DELETE /identity/v3/users/9a0b04c79ae344f5a28da82b6cf08631 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:25.259013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f93c24-e60b-437b-a278-322e2deabe35 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:25.259299 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f93c24-e60b-437b-a278-322e2deabe35 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:25.259574 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f93c24-e60b-437b-a278-322e2deabe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:25.271831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7673e57-1e6a-4f66-b593-c55dd4c9c5a6 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:25.304296 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-63f93c24-e60b-437b-a278-322e2deabe35 None None] MFA Rules not processed for user `d8733e916d634c0a967ba35261e0c3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:25.306323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-63f93c24-e60b-437b-a278-322e2deabe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:25.356932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876f5bc-1a1d-436d-a77a-9048371e4e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:25.358160 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876f5bc-1a1d-436d-a77a-9048371e4e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:25.358896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876f5bc-1a1d-436d-a77a-9048371e4e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:25.359380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876f5bc-1a1d-436d-a77a-9048371e4e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:25.360412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876f5bc-1a1d-436d-a77a-9048371e4e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:25.365046 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876f5bc-1a1d-436d-a77a-9048371e4e5b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:25.378542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 832/1673] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:25.379962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876f5bc-1a1d-436d-a77a-9048371e4e5b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:25.383363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a876f5bc-1a1d-436d-a77a-9048371e4e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:25.403585 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876f5bc-1a1d-436d-a77a-9048371e4e5b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:25.411523 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:25.412979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:25.412979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:25.413242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] PATH_INFO: `/v3/users/f9289bb21ac841c6a64208aad2c4d7b1` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:25.414809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9289bb21ac841c6a64208aad2c4d7b1)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:25.415498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:25.418019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:25.428029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:25.441516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 842/1674] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:25.444475 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8111-e514-414d-ae3f-1a6fb138885a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:25.444772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8111-e514-414d-ae3f-1a6fb138885a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:25.445340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8111-e514-414d-ae3f-1a6fb138885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:25.477191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f88f8111-e514-414d-ae3f-1a6fb138885a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:25.478815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f88f8111-e514-414d-ae3f-1a6fb138885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:25.492446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 843/1675] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:25.493628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f8111-e514-414d-ae3f-1a6fb138885a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:25.502186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f88f8111-e514-414d-ae3f-1a6fb138885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:25.516421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f8111-e514-414d-ae3f-1a6fb138885a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:25.531006 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2ca5e-d05c-4316-b062-efaabff923e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:25.532256 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2ca5e-d05c-4316-b062-efaabff923e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:25.532646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2ca5e-d05c-4316-b062-efaabff923e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:25.534188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2ca5e-d05c-4316-b062-efaabff923e4 admin admin] PATH_INFO: `/v3/projects/3360c689de944b38a25702d29e1d8746/users/7e5745c2d3ca456a86dd5d9054d64670/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:25.535022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9289bb21ac841c6a64208aad2c4d7b1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:25.535854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9289bb21ac841c6a64208aad2c4d7b1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:25.554627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2ca5e-d05c-4316-b062-efaabff923e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3360c689de944b38a25702d29e1d8746, user_id=7e5745c2d3ca456a86dd5d9054d64670, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:25.555175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9289bb21ac841c6a64208aad2c4d7b1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:25.560515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2ca5e-d05c-4316-b062-efaabff923e4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:25.572608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9289bb21ac841c6a64208aad2c4d7b1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:25.580361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 844/1676] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:25 2022] PUT /identity/v3/projects/3360c689de944b38a25702d29e1d8746/users/7e5745c2d3ca456a86dd5d9054d64670/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:25.587383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2ca5e-d05c-4316-b062-efaabff923e4 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:25.589637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-86a2ca5e-d05c-4316-b062-efaabff923e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:25.596932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9289bb21ac841c6a64208aad2c4d7b1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:25.608174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 833/1677] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:25 2022] DELETE /identity/v3/users/f9289bb21ac841c6a64208aad2c4d7b1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:25.609257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:25.611424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:25.712090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018db4b8-245c-49ff-88fa-bb54f37b63fe admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:25.716787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95438cd7-e76b-4347-824f-fb91cb163329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:25.717587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95438cd7-e76b-4347-824f-fb91cb163329 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:25.717976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95438cd7-e76b-4347-824f-fb91cb163329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:25.719323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95438cd7-e76b-4347-824f-fb91cb163329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:25.721829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-95438cd7-e76b-4347-824f-fb91cb163329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:25.731075 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2ca5e-d05c-4316-b062-efaabff923e4 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:25.867917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc0c60-53ce-4a80-ace6-c5f9a99571e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:25.868786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc0c60-53ce-4a80-ace6-c5f9a99571e5 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:25.868903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95438cd7-e76b-4347-824f-fb91cb163329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:25.869068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc0c60-53ce-4a80-ace6-c5f9a99571e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:25.869342 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc0c60-53ce-4a80-ace6-c5f9a99571e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:25.870326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95438cd7-e76b-4347-824f-fb91cb163329 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:25.875436 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-addc0c60-53ce-4a80-ace6-c5f9a99571e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:25.897824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 834/1678] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:25.899348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dabec-aecf-494a-9f05-cef477502766 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:25.899348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dabec-aecf-494a-9f05-cef477502766 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:25.902738 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dabec-aecf-494a-9f05-cef477502766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:25.993740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc0c60-53ce-4a80-ace6-c5f9a99571e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:25.995962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc0c60-53ce-4a80-ace6-c5f9a99571e5 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:26.006258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:26.023579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 845/1679] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:26.025123 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664133b-b2fe-4043-a1b8-c5f58553210c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:26.025469 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664133b-b2fe-4043-a1b8-c5f58553210c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:26.025754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664133b-b2fe-4043-a1b8-c5f58553210c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:26.068731 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1664133b-b2fe-4043-a1b8-c5f58553210c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:26.072436 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1664133b-b2fe-4043-a1b8-c5f58553210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:26.112202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 846/1680] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:26.186077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664133b-b2fe-4043-a1b8-c5f58553210c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:26.187609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1664133b-b2fe-4043-a1b8-c5f58553210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:26.205931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7e7dabec-aecf-494a-9f05-cef477502766 None None] MFA Rules not processed for user `7e5745c2d3ca456a86dd5d9054d64670`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:26.207423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664133b-b2fe-4043-a1b8-c5f58553210c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:26.208807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7e7dabec-aecf-494a-9f05-cef477502766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:26.222599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62505e-36e5-4316-a38e-63ba19a126a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:26.223421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62505e-36e5-4316-a38e-63ba19a126a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:26.223728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62505e-36e5-4316-a38e-63ba19a126a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:26.224005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62505e-36e5-4316-a38e-63ba19a126a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:26.234596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:26.244973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62505e-36e5-4316-a38e-63ba19a126a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:26.246672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62505e-36e5-4316-a38e-63ba19a126a7 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:26.272829 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 847/1681] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:17:26.309663 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 835/1682] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:26.321298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62505e-36e5-4316-a38e-63ba19a126a7 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:26.323796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2c62505e-36e5-4316-a38e-63ba19a126a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:26.466424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62505e-36e5-4316-a38e-63ba19a126a7 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:26.473499 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de194a-abc8-4c94-8bad-38c6bbcd50ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:26.474571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de194a-abc8-4c94-8bad-38c6bbcd50ad service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:26.475057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de194a-abc8-4c94-8bad-38c6bbcd50ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:26.475954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de194a-abc8-4c94-8bad-38c6bbcd50ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:26.496056 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de194a-abc8-4c94-8bad-38c6bbcd50ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:26.499920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de194a-abc8-4c94-8bad-38c6bbcd50ad service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:26.528126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 848/1683] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:26.695071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dabec-aecf-494a-9f05-cef477502766 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:26.696748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7e7dabec-aecf-494a-9f05-cef477502766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:26.720709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dabec-aecf-494a-9f05-cef477502766 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:26.739072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:26.740259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:26.740717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:26.741146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] PATH_INFO: `/v3/projects/b5444dedbc2b4f0fa58947297b045cf4` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:26.745105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5444dedbc2b4f0fa58947297b045cf4)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:26.747247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:26.771704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de194a-abc8-4c94-8bad-38c6bbcd50ad service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:26.773054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-73de194a-abc8-4c94-8bad-38c6bbcd50ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:26.803377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de194a-abc8-4c94-8bad-38c6bbcd50ad service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:26.816456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:26.817468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:26.818733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:26.819536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] PATH_INFO: `/v3/projects/f2f1f397be9f48ab96650dc6bb9ded5a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:26.830036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f1f397be9f48ab96650dc6bb9ded5a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:26.832031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:26.860738 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5444dedbc2b4f0fa58947297b045cf4', 'request_id': 'req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:26.873992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5444dedbc2b4f0fa58947297b045cf4', 'request_id': 'req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:26.898613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5444dedbc2b4f0fa58947297b045cf4', 'request_id': 'req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:26.917643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] The token cache is being invalidate because project b5444dedbc2b4f0fa58947297b045cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:26.918494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:26.920182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-491d5ec3-2eb9-4b2e-b482-30dde34ee32f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:26.928649 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 836/1684] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:26 2022] DELETE /identity/v3/projects/b5444dedbc2b4f0fa58947297b045cf4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:26.932483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faa3f0-15f5-4af3-977f-28da4f68711b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:26.942327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faa3f0-15f5-4af3-977f-28da4f68711b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:26.942327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faa3f0-15f5-4af3-977f-28da4f68711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:26.952303 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f1f397be9f48ab96650dc6bb9ded5a', 'request_id': 'req-fbab1b2f-86c5-4796-b12c-41543774a5df'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:26.972385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f1f397be9f48ab96650dc6bb9ded5a', 'request_id': 'req-fbab1b2f-86c5-4796-b12c-41543774a5df'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:26.984842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-d7faa3f0-15f5-4af3-977f-28da4f68711b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:26.989757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d7faa3f0-15f5-4af3-977f-28da4f68711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:26.992051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f1f397be9f48ab96650dc6bb9ded5a', 'request_id': 'req-fbab1b2f-86c5-4796-b12c-41543774a5df'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.020535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] The token cache is being invalidate because project f2f1f397be9f48ab96650dc6bb9ded5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:27.021064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.021899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.024125 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 849/1685] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:26 2022] DELETE /identity/v3/projects/f2f1f397be9f48ab96650dc6bb9ded5a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:27.027655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:27.029413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:27.167385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 837/1686] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:27.175894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d496146-d957-4900-81cf-efeeba932a24 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:27.176360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d496146-d957-4900-81cf-efeeba932a24 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:27.176860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d496146-d957-4900-81cf-efeeba932a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:27.207667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6d496146-d957-4900-81cf-efeeba932a24 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:27.208999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6d496146-d957-4900-81cf-efeeba932a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:27.218803 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1b2f-86c5-4796-b12c-41543774a5df admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:27.228955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 838/1687] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:27.230325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d496146-d957-4900-81cf-efeeba932a24 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:27.239894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:27.240908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:27.241250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:27.241880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] PATH_INFO: `/v3/users/1fc4dd1c91dc4c80ac0a766fd9194c27` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:27.244177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc4dd1c91dc4c80ac0a766fd9194c27)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:27.249183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:27.252897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d496146-d957-4900-81cf-efeeba932a24 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:27.266417 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:27.273239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec22207-48fa-4884-928e-59abede599ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:27.274175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22207-48fa-4884-928e-59abede599ca admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:27.274572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22207-48fa-4884-928e-59abede599ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:27.274955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22207-48fa-4884-928e-59abede599ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:27.275809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec22207-48fa-4884-928e-59abede599ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:27.276178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec22207-48fa-4884-928e-59abede599ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:27.277889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec22207-48fa-4884-928e-59abede599ca admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:27.308898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 839/1688] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:27.310188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec22207-48fa-4884-928e-59abede599ca admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:27.329398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec22207-48fa-4884-928e-59abede599ca admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:27.340768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51035369-fcbf-4333-939a-2dc9cd9653c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:27.341547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51035369-fcbf-4333-939a-2dc9cd9653c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:27.341886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51035369-fcbf-4333-939a-2dc9cd9653c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:27.342212 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51035369-fcbf-4333-939a-2dc9cd9653c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:27.343054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51035369-fcbf-4333-939a-2dc9cd9653c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:27.343168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc4dd1c91dc4c80ac0a766fd9194c27'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.347211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51035369-fcbf-4333-939a-2dc9cd9653c5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:27.347427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc4dd1c91dc4c80ac0a766fd9194c27'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.370724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc4dd1c91dc4c80ac0a766fd9194c27'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.396559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc4dd1c91dc4c80ac0a766fd9194c27'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.408698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 840/1689] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:27 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:27.413221 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51035369-fcbf-4333-939a-2dc9cd9653c5 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:27.414143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc4dd1c91dc4c80ac0a766fd9194c27'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.421438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:27.431415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 850/1690] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:27 2022] DELETE /identity/v3/users/1fc4dd1c91dc4c80ac0a766fd9194c27 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:17:27.532440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51035369-fcbf-4333-939a-2dc9cd9653c5 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:27.552166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:27.554264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:27.660794 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91be819-9968-44a4-baa3-8acaed711c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:27.661770 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be819-9968-44a4-baa3-8acaed711c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:27.662123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be819-9968-44a4-baa3-8acaed711c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:27.662489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91be819-9968-44a4-baa3-8acaed711c83 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:27.663268 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91be819-9968-44a4-baa3-8acaed711c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:27.667261 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91be819-9968-44a4-baa3-8acaed711c83 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:27.700422 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6884737-e3e0-42b4-bdad-c734ca9acbd1 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:27.715260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 841/1691] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:27 2022] POST /identity/v3/users => generated 303 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:27.719345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91be819-9968-44a4-baa3-8acaed711c83 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:27.719948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:27.721102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:27.721454 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:27.721736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] PATH_INFO: `/v3/projects/eea36b6c2ea44881b5c69b4c70856918` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:27.721852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d91be819-9968-44a4-baa3-8acaed711c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:27.733380 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea36b6c2ea44881b5c69b4c70856918)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:27.735410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:27.750363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91be819-9968-44a4-baa3-8acaed711c83 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:27.762166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8effeb-1bfc-43a8-b577-ab6cec68272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:27.763077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8effeb-1bfc-43a8-b577-ab6cec68272b admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:27.763453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8effeb-1bfc-43a8-b577-ab6cec68272b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:27.764140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8effeb-1bfc-43a8-b577-ab6cec68272b admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:27.765044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8effeb-1bfc-43a8-b577-ab6cec68272b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:27.768100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8effeb-1bfc-43a8-b577-ab6cec68272b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:27.794785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 842/1692] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:27.799139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8effeb-1bfc-43a8-b577-ab6cec68272b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:27.823217 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8effeb-1bfc-43a8-b577-ab6cec68272b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:27.832457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea36b6c2ea44881b5c69b4c70856918', 'request_id': 'req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.843715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea36b6c2ea44881b5c69b4c70856918', 'request_id': 'req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.865635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea36b6c2ea44881b5c69b4c70856918', 'request_id': 'req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.876435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] The token cache is being invalidate because project eea36b6c2ea44881b5c69b4c70856918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:27.879410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.881637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:27.886801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 851/1693] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:27 2022] DELETE /identity/v3/projects/eea36b6c2ea44881b5c69b4c70856918 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:27.891030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:27.894420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:27.918576 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:27.957987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23905e3-5976-456b-9a8b-64fcc1e9606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:27.958965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23905e3-5976-456b-9a8b-64fcc1e9606d admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:27.959242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23905e3-5976-456b-9a8b-64fcc1e9606d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:27.959637 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23905e3-5976-456b-9a8b-64fcc1e9606d admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:27.960524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23905e3-5976-456b-9a8b-64fcc1e9606d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:27.962374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23905e3-5976-456b-9a8b-64fcc1e9606d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:27.994016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 843/1694] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:27.998663 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23905e3-5976-456b-9a8b-64fcc1e9606d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:28.003261 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e23905e3-5976-456b-9a8b-64fcc1e9606d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:28.034357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23905e3-5976-456b-9a8b-64fcc1e9606d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:28.051106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdacfb-7441-4397-bd09-7e64a206bc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:28.052159 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdacfb-7441-4397-bd09-7e64a206bc17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:28.052543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdacfb-7441-4397-bd09-7e64a206bc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:28.052991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdacfb-7441-4397-bd09-7e64a206bc17 admin admin] PATH_INFO: `/v3/projects/0dfb0dd1f6be4d189923681120528eae/users/3c7bdd818a984cf4a8b71427835330bc/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:28.109561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf245d-9566-40ea-8f4b-2f4ddb5efaa0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:28.110586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdacfb-7441-4397-bd09-7e64a206bc17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfb0dd1f6be4d189923681120528eae, user_id=3c7bdd818a984cf4a8b71427835330bc, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:28.113703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdacfb-7441-4397-bd09-7e64a206bc17 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:28.115709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:28.116620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:28.116980 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:28.117156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] PATH_INFO: `/v3/users/cd127f8e2eb34b5f923c7340e011c080` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:28.118443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd127f8e2eb34b5f923c7340e011c080)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:28.120589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:28.155694 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 844/1695] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:27 2022] PUT /identity/v3/projects/0dfb0dd1f6be4d189923681120528eae/users/3c7bdd818a984cf4a8b71427835330bc/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:28.172031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb02200-87a7-4b78-8ee0-be93badc0b77 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:28.172380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb02200-87a7-4b78-8ee0-be93badc0b77 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:28.172866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb02200-87a7-4b78-8ee0-be93badc0b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:28.185233 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:28.201751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd127f8e2eb34b5f923c7340e011c080'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:28.202692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd127f8e2eb34b5f923c7340e011c080'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:28.221892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd127f8e2eb34b5f923c7340e011c080'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:28.247166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd127f8e2eb34b5f923c7340e011c080'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:28.251150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-aeb02200-87a7-4b78-8ee0-be93badc0b77 None None] MFA Rules not processed for user `3c7bdd818a984cf4a8b71427835330bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:28.254744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-aeb02200-87a7-4b78-8ee0-be93badc0b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:28.264470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd127f8e2eb34b5f923c7340e011c080'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:28.306826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 852/1696] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:27 2022] DELETE /identity/v3/users/cd127f8e2eb34b5f923c7340e011c080 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:28.426338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 845/1697] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:28.428142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:28.430191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:28.593305 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb02200-87a7-4b78-8ee0-be93badc0b77 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:28.595145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-aeb02200-87a7-4b78-8ee0-be93badc0b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:28.596164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102b80c-2db5-46b9-b4b4-7e3c5f72950a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:28.621360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf4ec4-4303-4063-9b85-ff574a9b1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:28.622032 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf4ec4-4303-4063-9b85-ff574a9b1c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:28.622323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf4ec4-4303-4063-9b85-ff574a9b1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:28.622998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf4ec4-4303-4063-9b85-ff574a9b1c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:28.623711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf4ec4-4303-4063-9b85-ff574a9b1c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:28.625806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf4ec4-4303-4063-9b85-ff574a9b1c85 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:28.685372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 853/1698] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:28 2022] POST /identity/v3/projects => generated 405 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:28.691014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf4ec4-4303-4063-9b85-ff574a9b1c85 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:28.751745 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:28.827984 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb02200-87a7-4b78-8ee0-be93badc0b77 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:28.901910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf4ec4-4303-4063-9b85-ff574a9b1c85 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:28.920580 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019365a-0810-43c8-95a2-8203435ff30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:28.921448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019365a-0810-43c8-95a2-8203435ff30d admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:28.923982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019365a-0810-43c8-95a2-8203435ff30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:28.923982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019365a-0810-43c8-95a2-8203435ff30d admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:28.923982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019365a-0810-43c8-95a2-8203435ff30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:28.924923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019365a-0810-43c8-95a2-8203435ff30d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:28.984701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 854/1699] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:28 2022] POST /identity/v3/users => generated 309 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:28.985872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019365a-0810-43c8-95a2-8203435ff30d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:28.995538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:28.996871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:28.999718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:29.000087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] PATH_INFO: `/v3/projects/20cbee556cac4578b9dd6621fe281634` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:29.003322 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=20cbee556cac4578b9dd6621fe281634)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:29.008679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019365a-0810-43c8-95a2-8203435ff30d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:29.009050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:29.024616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf487b3-ecb9-4aa6-b680-3c1f8215f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:29.025472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf487b3-ecb9-4aa6-b680-3c1f8215f108 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:29.025753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf487b3-ecb9-4aa6-b680-3c1f8215f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:29.026020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf487b3-ecb9-4aa6-b680-3c1f8215f108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:29.026776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf487b3-ecb9-4aa6-b680-3c1f8215f108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:29.028817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf487b3-ecb9-4aa6-b680-3c1f8215f108 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:29.081120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 855/1700] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:29.082403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf487b3-ecb9-4aa6-b680-3c1f8215f108 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:29.109899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf487b3-ecb9-4aa6-b680-3c1f8215f108 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:29.113407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:29.126160 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20cbee556cac4578b9dd6621fe281634', 'request_id': 'req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:29.145546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20cbee556cac4578b9dd6621fe281634', 'request_id': 'req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:29.165529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20cbee556cac4578b9dd6621fe281634', 'request_id': 'req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:29.186405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] The token cache is being invalidate because project 20cbee556cac4578b9dd6621fe281634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:29.186706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:29.191685 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-0a394dbf-bf3c-467e-b4d8-c0de8b943ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:29.195818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 846/1701] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:28 2022] DELETE /identity/v3/projects/20cbee556cac4578b9dd6621fe281634 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:17:29.201068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77682d46-b8a9-4135-8893-b564a7ccc2bb None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:29.201417 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77682d46-b8a9-4135-8893-b564a7ccc2bb None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:29.201822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77682d46-b8a9-4135-8893-b564a7ccc2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:29.251531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-77682d46-b8a9-4135-8893-b564a7ccc2bb None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:29.256753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-77682d46-b8a9-4135-8893-b564a7ccc2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:29.307510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b2750-eebc-4d87-a235-b59949f34abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:29.308456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b2750-eebc-4d87-a235-b59949f34abc admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:29.308736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b2750-eebc-4d87-a235-b59949f34abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:29.309005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b2750-eebc-4d87-a235-b59949f34abc admin admin] PATH_INFO: `/v3/projects/219f02346e3143d1b59045b0850ed05a/users/49ad7ff0a4844c24802ced496d91f232/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:29.347911 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b2750-eebc-4d87-a235-b59949f34abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=219f02346e3143d1b59045b0850ed05a, user_id=49ad7ff0a4844c24802ced496d91f232, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:29.354577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b2750-eebc-4d87-a235-b59949f34abc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:29.381701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 856/1702] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:29 2022] PUT /identity/v3/projects/219f02346e3143d1b59045b0850ed05a/users/49ad7ff0a4844c24802ced496d91f232/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:29.384359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b2750-eebc-4d87-a235-b59949f34abc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:29.388089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-958b2750-eebc-4d87-a235-b59949f34abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:29.432290 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 847/1703] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:29.443205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415ec17-e910-44db-8d0e-ed821e8c5db7 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:29.443488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415ec17-e910-44db-8d0e-ed821e8c5db7 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:29.443773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415ec17-e910-44db-8d0e-ed821e8c5db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:29.480837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b2750-eebc-4d87-a235-b59949f34abc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:29.486511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16459c-65ee-409d-8d8c-444f215f6030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:29.488001 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16459c-65ee-409d-8d8c-444f215f6030 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:29.488328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16459c-65ee-409d-8d8c-444f215f6030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:29.488600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16459c-65ee-409d-8d8c-444f215f6030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:29.489575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16459c-65ee-409d-8d8c-444f215f6030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:29.491423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16459c-65ee-409d-8d8c-444f215f6030 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:29.500610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8415ec17-e910-44db-8d0e-ed821e8c5db7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:29.502055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8415ec17-e910-44db-8d0e-ed821e8c5db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:29.510003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 857/1704] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:29.510983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16459c-65ee-409d-8d8c-444f215f6030 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:29.523264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16459c-65ee-409d-8d8c-444f215f6030 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:29.528272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf59df9-3f90-4f1e-91c1-95e2418459fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:29.529422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 848/1705] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:29.530435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf59df9-3f90-4f1e-91c1-95e2418459fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:29.530725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf59df9-3f90-4f1e-91c1-95e2418459fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:29.531000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf59df9-3f90-4f1e-91c1-95e2418459fc admin admin] PATH_INFO: `/v3/projects/219f02346e3143d1b59045b0850ed05a/users/49ad7ff0a4844c24802ced496d91f232/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:29.534018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415ec17-e910-44db-8d0e-ed821e8c5db7 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:29.534391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf59df9-3f90-4f1e-91c1-95e2418459fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=219f02346e3143d1b59045b0850ed05a, user_id=49ad7ff0a4844c24802ced496d91f232, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:29.537089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf59df9-3f90-4f1e-91c1-95e2418459fc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:29.553810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415ec17-e910-44db-8d0e-ed821e8c5db7 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:29.567886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b6554-343a-4135-a26f-e0fcbf80825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:29.568575 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b6554-343a-4135-a26f-e0fcbf80825f admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:29.568860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b6554-343a-4135-a26f-e0fcbf80825f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:29.569137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b6554-343a-4135-a26f-e0fcbf80825f admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:29.569890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b6554-343a-4135-a26f-e0fcbf80825f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:29.570195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b6554-343a-4135-a26f-e0fcbf80825f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:29.575457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b6554-343a-4135-a26f-e0fcbf80825f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:29.578516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 858/1706] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:29 2022] PUT /identity/v3/projects/219f02346e3143d1b59045b0850ed05a/users/49ad7ff0a4844c24802ced496d91f232/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:29.580281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382aff8-9fc4-41de-b2d5-a91a2bcf38da None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:29.580568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382aff8-9fc4-41de-b2d5-a91a2bcf38da None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:29.580840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382aff8-9fc4-41de-b2d5-a91a2bcf38da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:29.605390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:29.610899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 849/1707] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:29.616134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b6554-343a-4135-a26f-e0fcbf80825f admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:29.639748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b6554-343a-4135-a26f-e0fcbf80825f admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:29.665364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f382aff8-9fc4-41de-b2d5-a91a2bcf38da None None] MFA Rules not processed for user `49ad7ff0a4844c24802ced496d91f232`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:29.666655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f382aff8-9fc4-41de-b2d5-a91a2bcf38da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:29.779151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3eea4-b99f-479a-b82a-d003fd7bc3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:29.779856 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3eea4-b99f-479a-b82a-d003fd7bc3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:29.780136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3eea4-b99f-479a-b82a-d003fd7bc3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:29.780411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3eea4-b99f-479a-b82a-d003fd7bc3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:29.782582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3eea4-b99f-479a-b82a-d003fd7bc3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:29.785108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3eea4-b99f-479a-b82a-d003fd7bc3e2 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:29.845467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 850/1708] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:29 2022] POST /identity/v3/projects => generated 377 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:29.850844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3eea4-b99f-479a-b82a-d003fd7bc3e2 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:29.908573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 859/1709] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:29.916082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382aff8-9fc4-41de-b2d5-a91a2bcf38da None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:29.918089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f382aff8-9fc4-41de-b2d5-a91a2bcf38da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:29.942339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:29.998609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3eea4-b99f-479a-b82a-d003fd7bc3e2 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:30.004100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98c05f-f63a-48d4-8c50-4be660dca4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:30.004799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98c05f-f63a-48d4-8c50-4be660dca4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:30.005082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98c05f-f63a-48d4-8c50-4be660dca4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:30.005358 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98c05f-f63a-48d4-8c50-4be660dca4ee admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:30.006058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98c05f-f63a-48d4-8c50-4be660dca4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:30.008117 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98c05f-f63a-48d4-8c50-4be660dca4ee admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:30.046082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 851/1710] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:29 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:30.050007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98c05f-f63a-48d4-8c50-4be660dca4ee admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:30.070731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98c05f-f63a-48d4-8c50-4be660dca4ee admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:30.083804 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fed26-24dc-472c-9e81-be7985ffc896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:30.084540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fed26-24dc-472c-9e81-be7985ffc896 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:30.084888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fed26-24dc-472c-9e81-be7985ffc896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:30.085229 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fed26-24dc-472c-9e81-be7985ffc896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:30.086106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fed26-24dc-472c-9e81-be7985ffc896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:30.092370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fed26-24dc-472c-9e81-be7985ffc896 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:30.103862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382aff8-9fc4-41de-b2d5-a91a2bcf38da None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:30.140422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 852/1711] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:17:30.142373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fed26-24dc-472c-9e81-be7985ffc896 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:30.164308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fed26-24dc-472c-9e81-be7985ffc896 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:30.187644 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418f359-c019-4f37-997f-902456d67844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:30.188466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418f359-c019-4f37-997f-902456d67844 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:30.190842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418f359-c019-4f37-997f-902456d67844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:30.191203 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418f359-c019-4f37-997f-902456d67844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:30.195133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418f359-c019-4f37-997f-902456d67844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:30.200388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418f359-c019-4f37-997f-902456d67844 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:30.212812 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2327cf6-f2ee-43d2-a681-df30ff4d5ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:30.213499 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2327cf6-f2ee-43d2-a681-df30ff4d5ddc service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:30.213930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2327cf6-f2ee-43d2-a681-df30ff4d5ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:30.214087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2327cf6-f2ee-43d2-a681-df30ff4d5ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:30.241979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 853/1712] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:30.255178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418f359-c019-4f37-997f-902456d67844 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:30.306579 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418f359-c019-4f37-997f-902456d67844 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:30.341743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca33bd-ab2f-487a-985a-aaff43a73a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:30.344229 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca33bd-ab2f-487a-985a-aaff43a73a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:30.346728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca33bd-ab2f-487a-985a-aaff43a73a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:30.347245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca33bd-ab2f-487a-985a-aaff43a73a81 admin admin] PATH_INFO: `/v3/projects/e5c2e70ed1ad46bb8e588f5b231335fa/users/a398269fe6ba498397b68d8ede89db44/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:30.348865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:30.362543 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2327cf6-f2ee-43d2-a681-df30ff4d5ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:30.364081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2327cf6-f2ee-43d2-a681-df30ff4d5ddc service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:30.381945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 860/1713] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:29 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:17:30.401279 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca33bd-ab2f-487a-985a-aaff43a73a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c2e70ed1ad46bb8e588f5b231335fa, user_id=a398269fe6ba498397b68d8ede89db44, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:30.404982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca33bd-ab2f-487a-985a-aaff43a73a81 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:30.439241 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 854/1714] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:30 2022] PUT /identity/v3/projects/e5c2e70ed1ad46bb8e588f5b231335fa/users/a398269fe6ba498397b68d8ede89db44/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:30.450419 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85e30-9c4f-44e4-82c0-eb0694e28c05 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:30.450815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85e30-9c4f-44e4-82c0-eb0694e28c05 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:30.451110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85e30-9c4f-44e4-82c0-eb0694e28c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:30.543546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-06b85e30-9c4f-44e4-82c0-eb0694e28c05 None None] MFA Rules not processed for user `a398269fe6ba498397b68d8ede89db44`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:30.544987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-06b85e30-9c4f-44e4-82c0-eb0694e28c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:30.553353 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca33bd-ab2f-487a-985a-aaff43a73a81 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:30.555805 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c8ca33bd-ab2f-487a-985a-aaff43a73a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:30.780167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca33bd-ab2f-487a-985a-aaff43a73a81 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:30.798792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:30.800289 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:30.800836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:30.801324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] PATH_INFO: `/v3/projects/461b157d8b2b4bc19ff45bdf23d985c6` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:30.805123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] RBAC: Authorizing `identity:delete_project(project_id=461b157d8b2b4bc19ff45bdf23d985c6)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:30.808380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:30.833348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 861/1715] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:30.835837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b85e30-9c4f-44e4-82c0-eb0694e28c05 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:30.875155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b85e30-9c4f-44e4-82c0-eb0694e28c05 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:30.898020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461b157d8b2b4bc19ff45bdf23d985c6', 'request_id': 'req-46eb2988-7234-473d-9c8c-eecf44f9589d'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:30.907041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461b157d8b2b4bc19ff45bdf23d985c6', 'request_id': 'req-46eb2988-7234-473d-9c8c-eecf44f9589d'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:30.921225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461b157d8b2b4bc19ff45bdf23d985c6', 'request_id': 'req-46eb2988-7234-473d-9c8c-eecf44f9589d'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:30.974931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] The token cache is being invalidate because project 461b157d8b2b4bc19ff45bdf23d985c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:30.976371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:30.978715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:30.990982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 855/1716] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:30 2022] DELETE /identity/v3/projects/461b157d8b2b4bc19ff45bdf23d985c6 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:17:30.990982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:30.996346 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:31.033292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:31.093844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:31.102827 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:31.102827 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:31.103109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] PATH_INFO: `/v3/users/3c7bdd818a984cf4a8b71427835330bc` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:31.107327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7bdd818a984cf4a8b71427835330bc)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:31.114955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:31.197725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb2988-7234-473d-9c8c-eecf44f9589d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:31.205662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f66614-8ff7-4b33-8133-2c5b20dc2cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:31.206482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f66614-8ff7-4b33-8133-2c5b20dc2cce admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:31.206864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f66614-8ff7-4b33-8133-2c5b20dc2cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:31.207232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f66614-8ff7-4b33-8133-2c5b20dc2cce admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:31.208365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f66614-8ff7-4b33-8133-2c5b20dc2cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:31.212857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f66614-8ff7-4b33-8133-2c5b20dc2cce admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:31.268460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7bdd818a984cf4a8b71427835330bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:31.272371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 856/1717] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:30 2022] POST /identity/v3/projects => generated 377 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:31.274364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7bdd818a984cf4a8b71427835330bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:31.275425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5743e95-f5ea-4c9c-b3b1-31f223ba90c9 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:31.276867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5743e95-f5ea-4c9c-b3b1-31f223ba90c9 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:31.277492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5743e95-f5ea-4c9c-b3b1-31f223ba90c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:31.298798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7bdd818a984cf4a8b71427835330bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:31.330389 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-b5743e95-f5ea-4c9c-b3b1-31f223ba90c9 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:31.337714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b5743e95-f5ea-4c9c-b3b1-31f223ba90c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:31.346666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7bdd818a984cf4a8b71427835330bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:31.393620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7bdd818a984cf4a8b71427835330bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:31.415310 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 862/1718] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:30 2022] DELETE /identity/v3/users/3c7bdd818a984cf4a8b71427835330bc => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:31.416552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:31.419268 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:31.453857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:31.553777 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 857/1719] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:31.555945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c0e61-f311-4124-8a58-582ed8e9a7fe None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:31.556136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c0e61-f311-4124-8a58-582ed8e9a7fe None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:31.557488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c0e61-f311-4124-8a58-582ed8e9a7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:31.617308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-df6c0e61-f311-4124-8a58-582ed8e9a7fe None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:31.621417 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-df6c0e61-f311-4124-8a58-582ed8e9a7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:31.629138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf155cbb-62f0-4360-908a-35b3aa565e7c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:31.640768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc934-91ba-4029-aaba-7ba6297ba088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:31.641419 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc934-91ba-4029-aaba-7ba6297ba088 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:31.646443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc934-91ba-4029-aaba-7ba6297ba088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:31.646443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc934-91ba-4029-aaba-7ba6297ba088 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:31.647136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bc934-91ba-4029-aaba-7ba6297ba088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:31.649373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 858/1720] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:31.654703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c2b2-4ea5-4fe8-81fd-caf9d94a6594 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:31.655007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c2b2-4ea5-4fe8-81fd-caf9d94a6594 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:31.655288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c2b2-4ea5-4fe8-81fd-caf9d94a6594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:31.656865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bc934-91ba-4029-aaba-7ba6297ba088 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:31.717119 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 863/1721] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:31 2022] POST /identity/v3/users => generated 295 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:31.717763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-92a8c2b2-4ea5-4fe8-81fd-caf9d94a6594 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:31.719278 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc934-91ba-4029-aaba-7ba6297ba088 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:31.720384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-92a8c2b2-4ea5-4fe8-81fd-caf9d94a6594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:31.736346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1c4bc934-91ba-4029-aaba-7ba6297ba088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:31.763461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 859/1722] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:31.765772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8c2b2-4ea5-4fe8-81fd-caf9d94a6594 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:31.812506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8c2b2-4ea5-4fe8-81fd-caf9d94a6594 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:31.826649 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245acbe-31b2-4d0f-b3b3-8abd844252a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:31.827672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245acbe-31b2-4d0f-b3b3-8abd844252a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:31.828285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245acbe-31b2-4d0f-b3b3-8abd844252a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:31.828951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245acbe-31b2-4d0f-b3b3-8abd844252a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:31.831081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245acbe-31b2-4d0f-b3b3-8abd844252a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:31.833920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245acbe-31b2-4d0f-b3b3-8abd844252a3 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:31.862751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 860/1723] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:31.863834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245acbe-31b2-4d0f-b3b3-8abd844252a3 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:31.886029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245acbe-31b2-4d0f-b3b3-8abd844252a3 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:31.898100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d147a7-c2ad-4a1f-a6ee-e23728019d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:31.900699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d147a7-c2ad-4a1f-a6ee-e23728019d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:31.901122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d147a7-c2ad-4a1f-a6ee-e23728019d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:31.901465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d147a7-c2ad-4a1f-a6ee-e23728019d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:31.905062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d147a7-c2ad-4a1f-a6ee-e23728019d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:31.905521 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d147a7-c2ad-4a1f-a6ee-e23728019d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:31.910179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d147a7-c2ad-4a1f-a6ee-e23728019d13 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:31.927430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc934-91ba-4029-aaba-7ba6297ba088 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:31.940662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8b9a9-a8d0-48b7-80e7-cd0c960ee140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:31.945723 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8b9a9-a8d0-48b7-80e7-cd0c960ee140 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:31.945723 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8b9a9-a8d0-48b7-80e7-cd0c960ee140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:31.945723 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8b9a9-a8d0-48b7-80e7-cd0c960ee140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:31.958900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 861/1724] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:31.960088 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d147a7-c2ad-4a1f-a6ee-e23728019d13 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:31.998948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d147a7-c2ad-4a1f-a6ee-e23728019d13 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:32.008000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8b9a9-a8d0-48b7-80e7-cd0c960ee140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:32.011815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8b9a9-a8d0-48b7-80e7-cd0c960ee140 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:32.019297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da73ba4-447d-4805-a379-d6755754f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:32.022283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da73ba4-447d-4805-a379-d6755754f241 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:32.022724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da73ba4-447d-4805-a379-d6755754f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:32.023390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da73ba4-447d-4805-a379-d6755754f241 admin admin] PATH_INFO: `/v3/projects/aa32f451168346038f350811eeadf8d3/users/c4b300ae35d94985b6526275c4dea8b2/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:32.050130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 864/1725] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:32.050861 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8b9a9-a8d0-48b7-80e7-cd0c960ee140 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:32.074706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da73ba4-447d-4805-a379-d6755754f241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa32f451168346038f350811eeadf8d3, user_id=c4b300ae35d94985b6526275c4dea8b2, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:32.080948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8b9a9-a8d0-48b7-80e7-cd0c960ee140 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:32.082403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da73ba4-447d-4805-a379-d6755754f241 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:32.097628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf745-78b5-43d3-94d2-9d2e6e1470fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:32.099328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf745-78b5-43d3-94d2-9d2e6e1470fc admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:32.099700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf745-78b5-43d3-94d2-9d2e6e1470fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:32.100584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf745-78b5-43d3-94d2-9d2e6e1470fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:32.101202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bf745-78b5-43d3-94d2-9d2e6e1470fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:32.105488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bf745-78b5-43d3-94d2-9d2e6e1470fc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:32.124120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 862/1726] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:31 2022] PUT /identity/v3/projects/aa32f451168346038f350811eeadf8d3/users/c4b300ae35d94985b6526275c4dea8b2/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:32.129511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da73ba4-447d-4805-a379-d6755754f241 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:32.175816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 865/1727] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:32 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:32.180227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf745-78b5-43d3-94d2-9d2e6e1470fc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:32.222711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:32.294626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da73ba4-447d-4805-a379-d6755754f241 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:32.335327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf745-78b5-43d3-94d2-9d2e6e1470fc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:32.344902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4515a2-ec74-41c9-9cef-e2d3b12538e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:32.360144 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4515a2-ec74-41c9-9cef-e2d3b12538e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:32.360505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4515a2-ec74-41c9-9cef-e2d3b12538e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:32.360832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4515a2-ec74-41c9-9cef-e2d3b12538e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:32.361677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4515a2-ec74-41c9-9cef-e2d3b12538e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:32.366361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4515a2-ec74-41c9-9cef-e2d3b12538e9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:32.420336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 866/1728] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:32 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:17:32.420336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f2222-8212-4844-8446-2ab71f571113 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:32.420336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f2222-8212-4844-8446-2ab71f571113 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:32.420978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f2222-8212-4844-8446-2ab71f571113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:32.430475 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:32.447166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea595c10-47c5-4efb-91b9-1fb812b4384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:32.448028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea595c10-47c5-4efb-91b9-1fb812b4384d admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:32.448410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea595c10-47c5-4efb-91b9-1fb812b4384d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:32.448934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea595c10-47c5-4efb-91b9-1fb812b4384d admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:32.449795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea595c10-47c5-4efb-91b9-1fb812b4384d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:32.455927 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea595c10-47c5-4efb-91b9-1fb812b4384d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:32.459732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-536f2222-8212-4844-8446-2ab71f571113 None None] MFA Rules not processed for user `d8733e916d634c0a967ba35261e0c3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:32.461526 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-536f2222-8212-4844-8446-2ab71f571113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:32.499381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 863/1729] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:17:32.503216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea595c10-47c5-4efb-91b9-1fb812b4384d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:32.528175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea595c10-47c5-4efb-91b9-1fb812b4384d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:32.539875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e166cb6-c113-4d4b-8d76-3990cc18d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:32.540889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e166cb6-c113-4d4b-8d76-3990cc18d23f admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:32.541306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e166cb6-c113-4d4b-8d76-3990cc18d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:32.541688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e166cb6-c113-4d4b-8d76-3990cc18d23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:32.542591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e166cb6-c113-4d4b-8d76-3990cc18d23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:32.544336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e166cb6-c113-4d4b-8d76-3990cc18d23f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:32.581055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 867/1730] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:32.581055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f2222-8212-4844-8446-2ab71f571113 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:32.581254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 864/1731] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:32.581681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e166cb6-c113-4d4b-8d76-3990cc18d23f admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:32.599269 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f2222-8212-4844-8446-2ab71f571113 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:32.602786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e166cb6-c113-4d4b-8d76-3990cc18d23f admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:32.614760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e579c31-d2be-4680-abd7-d8ede04e69fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:32.615657 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579c31-d2be-4680-abd7-d8ede04e69fc admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:32.616034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579c31-d2be-4680-abd7-d8ede04e69fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:32.616419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579c31-d2be-4680-abd7-d8ede04e69fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:32.616744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e375c34-04a0-4c10-abb8-f4570d1c1dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:32.617376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e579c31-d2be-4680-abd7-d8ede04e69fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:32.617712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e375c34-04a0-4c10-abb8-f4570d1c1dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:32.619247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e579c31-d2be-4680-abd7-d8ede04e69fc admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:32.619473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e375c34-04a0-4c10-abb8-f4570d1c1dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:32.619769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e375c34-04a0-4c10-abb8-f4570d1c1dd2 admin admin] PATH_INFO: `/v3/projects/aa32f451168346038f350811eeadf8d3/users/c4b300ae35d94985b6526275c4dea8b2/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:32.625967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e375c34-04a0-4c10-abb8-f4570d1c1dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa32f451168346038f350811eeadf8d3, user_id=c4b300ae35d94985b6526275c4dea8b2, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:32.636235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e375c34-04a0-4c10-abb8-f4570d1c1dd2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:32.665060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 865/1732] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:17:32.666168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e579c31-d2be-4680-abd7-d8ede04e69fc admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:32.694814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 868/1733] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:32 2022] PUT /identity/v3/projects/aa32f451168346038f350811eeadf8d3/users/c4b300ae35d94985b6526275c4dea8b2/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:32.698456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fb7e2-944d-4762-b864-5b2007096347 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:32.698741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fb7e2-944d-4762-b864-5b2007096347 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:32.699014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fb7e2-944d-4762-b864-5b2007096347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:32.701107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e579c31-d2be-4680-abd7-d8ede04e69fc admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:32.805636 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a74fb7e2-944d-4762-b864-5b2007096347 None None] MFA Rules not processed for user `c4b300ae35d94985b6526275c4dea8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:32.806918 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a74fb7e2-944d-4762-b864-5b2007096347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:32.891074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19655e02-1b46-450e-842e-ed24d8ae69e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:32.892443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19655e02-1b46-450e-842e-ed24d8ae69e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:32.893428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19655e02-1b46-450e-842e-ed24d8ae69e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:32.893964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19655e02-1b46-450e-842e-ed24d8ae69e3 admin admin] PATH_INFO: `/v3/projects/e732571454b9414688e9a0ce751c4c6b/users/4abe008cb0a241f6ab24aa878d511712/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:32.934769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19655e02-1b46-450e-842e-ed24d8ae69e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e732571454b9414688e9a0ce751c4c6b, user_id=4abe008cb0a241f6ab24aa878d511712, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:32.937597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19655e02-1b46-450e-842e-ed24d8ae69e3 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:32.990859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 866/1734] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:32 2022] PUT /identity/v3/projects/e732571454b9414688e9a0ce751c4c6b/users/4abe008cb0a241f6ab24aa878d511712/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:32.995322 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6a00-db21-413d-b2d4-699d01e2d8cb None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:32.995775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6a00-db21-413d-b2d4-699d01e2d8cb None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:32.996243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6a00-db21-413d-b2d4-699d01e2d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:33.023569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 869/1735] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:33.033096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fb7e2-944d-4762-b864-5b2007096347 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:33.035046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a74fb7e2-944d-4762-b864-5b2007096347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:33.070310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-486f6a00-db21-413d-b2d4-699d01e2d8cb None None] MFA Rules not processed for user `4abe008cb0a241f6ab24aa878d511712`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:33.072368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-486f6a00-db21-413d-b2d4-699d01e2d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:33.151967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:33.181647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fb7e2-944d-4762-b864-5b2007096347 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:33.246897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:33.269286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 867/1736] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:33.275326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f6a00-db21-413d-b2d4-699d01e2d8cb None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:33.302617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3777e-8d29-4756-a86f-81b7b63270e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:33.304143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3777e-8d29-4756-a86f-81b7b63270e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:33.304856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3777e-8d29-4756-a86f-81b7b63270e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:33.305357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3777e-8d29-4756-a86f-81b7b63270e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:33.308270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-51c3777e-8d29-4756-a86f-81b7b63270e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:33.484047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3777e-8d29-4756-a86f-81b7b63270e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:33.490568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3777e-8d29-4756-a86f-81b7b63270e5 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:33.515678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 870/1737] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:17:33.537324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f6a00-db21-413d-b2d4-699d01e2d8cb None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:33.552502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11e1a-0296-4065-8a6f-8afb87b33196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:33.553424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11e1a-0296-4065-8a6f-8afb87b33196 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:33.553872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11e1a-0296-4065-8a6f-8afb87b33196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:33.559325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11e1a-0296-4065-8a6f-8afb87b33196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:33.560320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b11e1a-0296-4065-8a6f-8afb87b33196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:33.563446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b11e1a-0296-4065-8a6f-8afb87b33196 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:33.624570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 868/1738] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:33 2022] POST /identity/v3/projects => generated 369 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:33.628821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3777e-8d29-4756-a86f-81b7b63270e5 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:33.642837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3777e-8d29-4756-a86f-81b7b63270e5 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:33.804003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec64e3-1a7c-43df-9484-8271bc82a8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:33.804698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec64e3-1a7c-43df-9484-8271bc82a8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:33.804978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec64e3-1a7c-43df-9484-8271bc82a8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:33.805252 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec64e3-1a7c-43df-9484-8271bc82a8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:33.805988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec64e3-1a7c-43df-9484-8271bc82a8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:33.808688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec64e3-1a7c-43df-9484-8271bc82a8a1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:33.861316 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11e1a-0296-4065-8a6f-8afb87b33196 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:33.862448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 871/1739] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:33 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:33.904094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11e1a-0296-4065-8a6f-8afb87b33196 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:33.915873 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1356833-4d11-4f61-821e-0709500ecf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:33.916979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1356833-4d11-4f61-821e-0709500ecf44 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:33.917479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1356833-4d11-4f61-821e-0709500ecf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:33.918025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1356833-4d11-4f61-821e-0709500ecf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:33.919601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1356833-4d11-4f61-821e-0709500ecf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:33.921942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1356833-4d11-4f61-821e-0709500ecf44 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:33.957726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 869/1740] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:33.962615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec64e3-1a7c-43df-9484-8271bc82a8a1 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:33.985537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec64e3-1a7c-43df-9484-8271bc82a8a1 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:33.997079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04d8a8-5e31-47dd-9c3b-ce0424da0bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:33.998351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04d8a8-5e31-47dd-9c3b-ce0424da0bba admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:34.002309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04d8a8-5e31-47dd-9c3b-ce0424da0bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:34.002771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04d8a8-5e31-47dd-9c3b-ce0424da0bba admin admin] PATH_INFO: `/v3/projects/4d59b95956da49f58006ebad509afae5/users/0f5e0a091697437ca8bffbb5e9173799/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:34.063764 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f7d2-8fca-46f1-b216-976244d91e1f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:34.064752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f7d2-8fca-46f1-b216-976244d91e1f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:34.065469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f7d2-8fca-46f1-b216-976244d91e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:34.088136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04d8a8-5e31-47dd-9c3b-ce0424da0bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d59b95956da49f58006ebad509afae5, user_id=0f5e0a091697437ca8bffbb5e9173799, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:34.113036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04d8a8-5e31-47dd-9c3b-ce0424da0bba admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:34.155894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5ec0f7d2-8fca-46f1-b216-976244d91e1f None None] MFA Rules not processed for user `72f981c1a18d4460b7400036bb5d2e31`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:34.157903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5ec0f7d2-8fca-46f1-b216-976244d91e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:34.182862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 872/1741] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:33 2022] PUT /identity/v3/projects/4d59b95956da49f58006ebad509afae5/users/0f5e0a091697437ca8bffbb5e9173799/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:34.188501 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04d8a8-5e31-47dd-9c3b-ce0424da0bba admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:34.199446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ae04d8a8-5e31-47dd-9c3b-ce0424da0bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:34.328264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 870/1742] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:34.344537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f7d2-8fca-46f1-b216-976244d91e1f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:34.395530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:34.416672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04d8a8-5e31-47dd-9c3b-ce0424da0bba admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:34.427474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:34.432401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:34.433421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:34.438396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:34.438683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] PATH_INFO: `/v3/projects/0dfb0dd1f6be4d189923681120528eae` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:34.441031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dfb0dd1f6be4d189923681120528eae)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:34.448430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:34.528147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f7d2-8fca-46f1-b216-976244d91e1f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:34.547605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c1533-8f0d-4f93-ae80-d83618719dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:34.553050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c1533-8f0d-4f93-ae80-d83618719dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:34.553505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c1533-8f0d-4f93-ae80-d83618719dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:34.555696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c1533-8f0d-4f93-ae80-d83618719dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:34.562342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c1533-8f0d-4f93-ae80-d83618719dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:34.570433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c1533-8f0d-4f93-ae80-d83618719dd6 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:34.604329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 871/1743] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:34.609429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907f926-7002-4d50-95c9-d1e71329ffab None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:34.609727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907f926-7002-4d50-95c9-d1e71329ffab None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:34.611416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907f926-7002-4d50-95c9-d1e71329ffab None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:34.614061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 872/1744] 10.222.0.23 () {54 vars in 912 bytes} [Tue Jun 28 03:17:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:17:34.616004 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930caa-82fc-4ae7-b44f-098059d4fccf None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:34.616865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfb0dd1f6be4d189923681120528eae', 'request_id': 'req-96ad907e-8c7e-4b51-a2f7-81399345bb31'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:34.618355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930caa-82fc-4ae7-b44f-098059d4fccf None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:34.619510 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930caa-82fc-4ae7-b44f-098059d4fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:34.631888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfb0dd1f6be4d189923681120528eae', 'request_id': 'req-96ad907e-8c7e-4b51-a2f7-81399345bb31'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:34.660535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfb0dd1f6be4d189923681120528eae', 'request_id': 'req-96ad907e-8c7e-4b51-a2f7-81399345bb31'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:34.673905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-19930caa-82fc-4ae7-b44f-098059d4fccf None None] MFA Rules not processed for user `72f981c1a18d4460b7400036bb5d2e31`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:34.688262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-19930caa-82fc-4ae7-b44f-098059d4fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:34.690551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] The token cache is being invalidate because project 0dfb0dd1f6be4d189923681120528eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:34.691057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:34.693369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:34.699107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 873/1745] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:34 2022] DELETE /identity/v3/projects/0dfb0dd1f6be4d189923681120528eae => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:34.701400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:34.707966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:34.820354 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad907e-8c7e-4b51-a2f7-81399345bb31 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:34.825759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192c9b6-c57f-4993-98e6-c7ac861fdba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:34.826744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192c9b6-c57f-4993-98e6-c7ac861fdba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:34.827051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192c9b6-c57f-4993-98e6-c7ac861fdba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:34.829487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192c9b6-c57f-4993-98e6-c7ac861fdba0 admin admin] PATH_INFO: `/v3/projects/4d59b95956da49f58006ebad509afae5/users/0f5e0a091697437ca8bffbb5e9173799/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:34.831816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 873/1746] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:34.833633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d14582-8bbb-4782-935f-4784f553b116 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:34.834007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d14582-8bbb-4782-935f-4784f553b116 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:34.834492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d14582-8bbb-4782-935f-4784f553b116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:34.837824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192c9b6-c57f-4993-98e6-c7ac861fdba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d59b95956da49f58006ebad509afae5, user_id=0f5e0a091697437ca8bffbb5e9173799, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:34.843062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192c9b6-c57f-4993-98e6-c7ac861fdba0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:34.860945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 874/1747] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:34 2022] PUT /identity/v3/projects/4d59b95956da49f58006ebad509afae5/users/0f5e0a091697437ca8bffbb5e9173799/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:34.862539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192c9b6-c57f-4993-98e6-c7ac861fdba0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:34.864303 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7192c9b6-c57f-4993-98e6-c7ac861fdba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:34.950373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-57d14582-8bbb-4782-935f-4784f553b116 None None] MFA Rules not processed for user `d7e0632bc12346b38663a0ef97ab1a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:34.952178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-57d14582-8bbb-4782-935f-4784f553b116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:34.984257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192c9b6-c57f-4993-98e6-c7ac861fdba0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:34.994235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a477777-e9b0-4e99-ad2d-d5d5f3b8d474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:34.995546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a477777-e9b0-4e99-ad2d-d5d5f3b8d474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:34.999509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a477777-e9b0-4e99-ad2d-d5d5f3b8d474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:35.000403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a477777-e9b0-4e99-ad2d-d5d5f3b8d474 admin admin] PATH_INFO: `/v3/users/49ad7ff0a4844c24802ced496d91f232` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:35.002541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a477777-e9b0-4e99-ad2d-d5d5f3b8d474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ad7ff0a4844c24802ced496d91f232)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:35.006837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a477777-e9b0-4e99-ad2d-d5d5f3b8d474 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:35.071183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:35.108499 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 874/1748] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:17:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:35.115015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d14582-8bbb-4782-935f-4784f553b116 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:35.120495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-57d14582-8bbb-4782-935f-4784f553b116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:35.126255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0a477777-e9b0-4e99-ad2d-d5d5f3b8d474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ad7ff0a4844c24802ced496d91f232'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:35.136365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0a477777-e9b0-4e99-ad2d-d5d5f3b8d474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ad7ff0a4844c24802ced496d91f232'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:35.162523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0a477777-e9b0-4e99-ad2d-d5d5f3b8d474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ad7ff0a4844c24802ced496d91f232'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:35.198987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0a477777-e9b0-4e99-ad2d-d5d5f3b8d474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ad7ff0a4844c24802ced496d91f232'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:35.209206 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0a477777-e9b0-4e99-ad2d-d5d5f3b8d474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ad7ff0a4844c24802ced496d91f232'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:35.219880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 875/1749] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:34 2022] DELETE /identity/v3/users/49ad7ff0a4844c24802ced496d91f232 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:35.221544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625d36-2740-4388-a99b-e3cf60359a51 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:35.221929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625d36-2740-4388-a99b-e3cf60359a51 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:35.222276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625d36-2740-4388-a99b-e3cf60359a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:35.263572 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3e625d36-2740-4388-a99b-e3cf60359a51 None None] MFA Rules not processed for user `0f5e0a091697437ca8bffbb5e9173799`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:35.263920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3e625d36-2740-4388-a99b-e3cf60359a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:35.328532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d14582-8bbb-4782-935f-4784f553b116 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:35.338016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:35.499333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e58543-c3ae-4b68-8277-ff7cb054758d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:35.500549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58543-c3ae-4b68-8277-ff7cb054758d service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:35.500836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58543-c3ae-4b68-8277-ff7cb054758d service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:35.501213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58543-c3ae-4b68-8277-ff7cb054758d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:35.504087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 876/1750] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:35.505051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e625d36-2740-4388-a99b-e3cf60359a51 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:35.516431 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-50e58543-c3ae-4b68-8277-ff7cb054758d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:35.527557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3e625d36-2740-4388-a99b-e3cf60359a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:35.657219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e625d36-2740-4388-a99b-e3cf60359a51 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:35.662445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd896acf-4d05-4b7c-b98b-9aa729ee5ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:35.663658 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd896acf-4d05-4b7c-b98b-9aa729ee5ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:35.663985 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd896acf-4d05-4b7c-b98b-9aa729ee5ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:35.664271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd896acf-4d05-4b7c-b98b-9aa729ee5ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:35.667516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bd896acf-4d05-4b7c-b98b-9aa729ee5ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:35.686078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd896acf-4d05-4b7c-b98b-9aa729ee5ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:35.691019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd896acf-4d05-4b7c-b98b-9aa729ee5ad9 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:35.709283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e58543-c3ae-4b68-8277-ff7cb054758d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:35.712305 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 877/1751] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:35.713781 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747d89-024e-4718-8f7c-4e2d88a1fc67 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:35.714072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747d89-024e-4718-8f7c-4e2d88a1fc67 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:35.714448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747d89-024e-4718-8f7c-4e2d88a1fc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:35.714973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e58543-c3ae-4b68-8277-ff7cb054758d service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:35.743616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 875/1752] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:35.748247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e58543-c3ae-4b68-8277-ff7cb054758d service nova] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:35.751215 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-50e58543-c3ae-4b68-8277-ff7cb054758d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:35.798041 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-74747d89-024e-4718-8f7c-4e2d88a1fc67 None None] MFA Rules not processed for user `3f1875b5d8924eb29720e07e784fdd82`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:35.803580 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-74747d89-024e-4718-8f7c-4e2d88a1fc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:35.870806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:35.994351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 878/1753] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:36.007179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822d2dc-a223-48e4-8834-143b667d79ce None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:36.007874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822d2dc-a223-48e4-8834-143b667d79ce None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:36.008314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822d2dc-a223-48e4-8834-143b667d79ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:36.036371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e58543-c3ae-4b68-8277-ff7cb054758d service nova] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:36.051992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2d292-fc00-4a67-821b-465b925d58b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:36.053720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d292-fc00-4a67-821b-465b925d58b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:36.054011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d292-fc00-4a67-821b-465b925d58b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:36.054498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e822d2dc-a223-48e4-8834-143b667d79ce None None] MFA Rules not processed for user `3f1875b5d8924eb29720e07e784fdd82`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:36.055642 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d292-fc00-4a67-821b-465b925d58b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:36.056572 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e822d2dc-a223-48e4-8834-143b667d79ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:36.073270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 879/1754] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:36.091899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2d292-fc00-4a67-821b-465b925d58b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:36.093402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2d292-fc00-4a67-821b-465b925d58b8 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:36.147457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 876/1755] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:36.156793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822d2dc-a223-48e4-8834-143b667d79ce None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:36.158681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e822d2dc-a223-48e4-8834-143b667d79ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:36.327091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822d2dc-a223-48e4-8834-143b667d79ce None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:36.333811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:36.339684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:36.340110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:36.340426 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] PATH_INFO: `/v3/projects/219f02346e3143d1b59045b0850ed05a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:36.342094 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] RBAC: Authorizing `identity:delete_project(project_id=219f02346e3143d1b59045b0850ed05a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:36.346613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:36.424914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219f02346e3143d1b59045b0850ed05a', 'request_id': 'req-0967e8c6-4c2b-4948-8661-715090a174df'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:36.439381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219f02346e3143d1b59045b0850ed05a', 'request_id': 'req-0967e8c6-4c2b-4948-8661-715090a174df'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:36.458875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219f02346e3143d1b59045b0850ed05a', 'request_id': 'req-0967e8c6-4c2b-4948-8661-715090a174df'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:36.473867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] The token cache is being invalidate because project 219f02346e3143d1b59045b0850ed05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:36.474383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:36.475502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0967e8c6-4c2b-4948-8661-715090a174df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:36.477941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 880/1756] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:36 2022] DELETE /identity/v3/projects/219f02346e3143d1b59045b0850ed05a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:36.484395 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf17954-1545-430e-a531-5af8dee0a804 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:36.484481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf17954-1545-430e-a531-5af8dee0a804 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:36.484749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf17954-1545-430e-a531-5af8dee0a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:36.585436 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-0cf17954-1545-430e-a531-5af8dee0a804 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:36.592864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-0cf17954-1545-430e-a531-5af8dee0a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:36.675920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:36.709378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 877/1757] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:36.718814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113901b-df9c-43fc-aa2e-3a1205e7109b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:36.719602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113901b-df9c-43fc-aa2e-3a1205e7109b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:36.719602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113901b-df9c-43fc-aa2e-3a1205e7109b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:36.766624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5113901b-df9c-43fc-aa2e-3a1205e7109b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:36.767921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5113901b-df9c-43fc-aa2e-3a1205e7109b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:36.791976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 881/1758] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:36.796791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf17954-1545-430e-a531-5af8dee0a804 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:36.809071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf17954-1545-430e-a531-5af8dee0a804 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:36.821719 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bf019-e6ec-469f-96b3-6f74bbfc0bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:36.822444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bf019-e6ec-469f-96b3-6f74bbfc0bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:36.823867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bf019-e6ec-469f-96b3-6f74bbfc0bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:36.824154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bf019-e6ec-469f-96b3-6f74bbfc0bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:36.827763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bf019-e6ec-469f-96b3-6f74bbfc0bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:36.828085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bf019-e6ec-469f-96b3-6f74bbfc0bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:36.829808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bf019-e6ec-469f-96b3-6f74bbfc0bfd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:36.866113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 878/1759] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:36.870755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113901b-df9c-43fc-aa2e-3a1205e7109b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:36.884619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113901b-df9c-43fc-aa2e-3a1205e7109b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:36.899022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b943dd-9ad8-4ed0-a6ac-1a9832a734e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:36.899776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b943dd-9ad8-4ed0-a6ac-1a9832a734e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:36.900047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b943dd-9ad8-4ed0-a6ac-1a9832a734e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:36.900321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b943dd-9ad8-4ed0-a6ac-1a9832a734e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:36.901027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b943dd-9ad8-4ed0-a6ac-1a9832a734e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:36.907739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b943dd-9ad8-4ed0-a6ac-1a9832a734e1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:36.913343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16a0eb-997b-40d1-b665-9acfd1ccb44b None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:36.914166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16a0eb-997b-40d1-b665-9acfd1ccb44b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:36.914718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16a0eb-997b-40d1-b665-9acfd1ccb44b None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:36.916802 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 879/1760] 10.222.0.23 () {54 vars in 912 bytes} [Tue Jun 28 03:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:17:36.925942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d0ec-c1db-4abd-b1cb-560eaad5230e None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:36.928401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d0ec-c1db-4abd-b1cb-560eaad5230e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:36.932778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d0ec-c1db-4abd-b1cb-560eaad5230e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:36.950988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 882/1761] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:36 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:17:36.952063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b943dd-9ad8-4ed0-a6ac-1a9832a734e1 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:36.974508 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-dee7d0ec-c1db-4abd-b1cb-560eaad5230e None None] MFA Rules not processed for user `d7e0632bc12346b38663a0ef97ab1a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:36.976800 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-dee7d0ec-c1db-4abd-b1cb-560eaad5230e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:36.986026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:37.078159 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 880/1762] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:17:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:37.078383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d0ec-c1db-4abd-b1cb-560eaad5230e None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:37.083113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-dee7d0ec-c1db-4abd-b1cb-560eaad5230e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:37.141611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b943dd-9ad8-4ed0-a6ac-1a9832a734e1 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:37.149309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30514524-4892-4aad-b61d-573768deea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:37.150608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30514524-4892-4aad-b61d-573768deea69 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:37.151150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30514524-4892-4aad-b61d-573768deea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:37.151711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30514524-4892-4aad-b61d-573768deea69 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:37.152631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30514524-4892-4aad-b61d-573768deea69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:37.155916 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30514524-4892-4aad-b61d-573768deea69 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:37.203173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 883/1763] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:36 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:37.203999 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30514524-4892-4aad-b61d-573768deea69 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:37.211943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-30514524-4892-4aad-b61d-573768deea69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:37.234846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30514524-4892-4aad-b61d-573768deea69 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:37.242130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa0c00-4f82-490d-9e9d-db2fc37b1f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:37.243079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0c00-4f82-490d-9e9d-db2fc37b1f6d service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:37.243839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0c00-4f82-490d-9e9d-db2fc37b1f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:37.244307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0c00-4f82-490d-9e9d-db2fc37b1f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:37.259745 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa0c00-4f82-490d-9e9d-db2fc37b1f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:37.262596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa0c00-4f82-490d-9e9d-db2fc37b1f6d service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:37.266135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d0ec-c1db-4abd-b1cb-560eaad5230e None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:37.274584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 884/1764] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:37.275754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa0c00-4f82-490d-9e9d-db2fc37b1f6d service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:37.278333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1faa0c00-4f82-490d-9e9d-db2fc37b1f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:37.290017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc422b13-bb24-4e99-a429-723e400645be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:37.290729 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc422b13-bb24-4e99-a429-723e400645be service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:37.291009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc422b13-bb24-4e99-a429-723e400645be service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:37.291282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc422b13-bb24-4e99-a429-723e400645be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:37.296710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fc422b13-bb24-4e99-a429-723e400645be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:37.422368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa0c00-4f82-490d-9e9d-db2fc37b1f6d service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:37.435823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5f299-0d8c-46e5-86c6-e6f28d0f3a0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:37.436524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5f299-0d8c-46e5-86c6-e6f28d0f3a0f service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:37.437108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc422b13-bb24-4e99-a429-723e400645be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:37.438543 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5f299-0d8c-46e5-86c6-e6f28d0f3a0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:37.438775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc422b13-bb24-4e99-a429-723e400645be service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:37.438887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5f299-0d8c-46e5-86c6-e6f28d0f3a0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:37.445243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0bc5f299-0d8c-46e5-86c6-e6f28d0f3a0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:37.469312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 881/1765] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:37.471191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e275b12-a774-4132-8bcd-46f405e9dc03 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:37.471419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e275b12-a774-4132-8bcd-46f405e9dc03 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:37.471707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e275b12-a774-4132-8bcd-46f405e9dc03 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:37.479876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 882/1766] 10.222.0.23 () {54 vars in 960 bytes} [Tue Jun 28 03:17:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:17:37.481035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e275b12-a774-4132-8bcd-46f405e9dc03 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:37.525910 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e275b12-a774-4132-8bcd-46f405e9dc03 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:37.540890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941ac3e-671b-4bef-8b6b-46e33b0b2adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:37.541630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941ac3e-671b-4bef-8b6b-46e33b0b2adf admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:37.542014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941ac3e-671b-4bef-8b6b-46e33b0b2adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:37.542311 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941ac3e-671b-4bef-8b6b-46e33b0b2adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:37.543173 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941ac3e-671b-4bef-8b6b-46e33b0b2adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:37.547646 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941ac3e-671b-4bef-8b6b-46e33b0b2adf admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:37.568600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 883/1767] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:37.570017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4518c-a2d2-46a9-83ae-7f4176532d5b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:37.570321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4518c-a2d2-46a9-83ae-7f4176532d5b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:37.570638 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4518c-a2d2-46a9-83ae-7f4176532d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:37.574261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5f299-0d8c-46e5-86c6-e6f28d0f3a0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:37.580833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5f299-0d8c-46e5-86c6-e6f28d0f3a0f service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:37.600986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 885/1768] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:37.601899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5f299-0d8c-46e5-86c6-e6f28d0f3a0f service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:37.624058 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5f299-0d8c-46e5-86c6-e6f28d0f3a0f service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:37.624823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-80e4518c-a2d2-46a9-83ae-7f4176532d5b None None] MFA Rules not processed for user `28b8048235c6421eae12ca99f80ed5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:37.626387 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-80e4518c-a2d2-46a9-83ae-7f4176532d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:37.630476 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bd1bb-dbe4-4709-8bf2-f77e10b671bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:37.631357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd1bb-dbe4-4709-8bf2-f77e10b671bc admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:37.631777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd1bb-dbe4-4709-8bf2-f77e10b671bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:37.632221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd1bb-dbe4-4709-8bf2-f77e10b671bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:37.633221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bd1bb-dbe4-4709-8bf2-f77e10b671bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:37.635504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bd1bb-dbe4-4709-8bf2-f77e10b671bc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:37.636923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:37.674848 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 886/1769] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:37.676008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bd1bb-dbe4-4709-8bf2-f77e10b671bc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:37.690082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bd1bb-dbe4-4709-8bf2-f77e10b671bc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:37.701564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2841034-f39e-400f-a01a-169076bb12e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:37.702970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2841034-f39e-400f-a01a-169076bb12e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:37.703379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2841034-f39e-400f-a01a-169076bb12e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:37.703801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2841034-f39e-400f-a01a-169076bb12e8 admin admin] PATH_INFO: `/v3/projects/6e0e0cb5f1204ae39afeda841307a983/users/3cbf81d344314961bbf76cc03f10bd22/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:37.751475 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2841034-f39e-400f-a01a-169076bb12e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0e0cb5f1204ae39afeda841307a983, user_id=3cbf81d344314961bbf76cc03f10bd22, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:37.756255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2841034-f39e-400f-a01a-169076bb12e8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:37.802871 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 887/1770] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:37 2022] PUT /identity/v3/projects/6e0e0cb5f1204ae39afeda841307a983/users/3cbf81d344314961bbf76cc03f10bd22/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:37.815771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bc45f-d025-469d-82c6-e3e36c71bc8e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:37.816368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bc45f-d025-469d-82c6-e3e36c71bc8e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:37.817232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bc45f-d025-469d-82c6-e3e36c71bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:37.827821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:37.840113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 884/1771] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Jun 28 03:17:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:37.851702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4518c-a2d2-46a9-83ae-7f4176532d5b None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:37.866157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4518c-a2d2-46a9-83ae-7f4176532d5b None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:37.877854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ea6bc45f-d025-469d-82c6-e3e36c71bc8e None None] MFA Rules not processed for user `3cbf81d344314961bbf76cc03f10bd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:37.879796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ea6bc45f-d025-469d-82c6-e3e36c71bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:38.010194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e839d6-e5a2-4737-833f-3bf765f7b4da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8048235c6421eae12ca99f80ed5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:38.010934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e839d6-e5a2-4737-833f-3bf765f7b4da service placement] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:38.011675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e839d6-e5a2-4737-833f-3bf765f7b4da service placement] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:38.011675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e839d6-e5a2-4737-833f-3bf765f7b4da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:38.018232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-89e839d6-e5a2-4737-833f-3bf765f7b4da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:38.041069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e839d6-e5a2-4737-833f-3bf765f7b4da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:38.043384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e839d6-e5a2-4737-833f-3bf765f7b4da service placement] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:38.062736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 885/1772] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:38.073254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 888/1773] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:38.078115 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e839d6-e5a2-4737-833f-3bf765f7b4da service placement] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:38.190882 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e839d6-e5a2-4737-833f-3bf765f7b4da service placement] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:38.200367 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad25534-ec42-415c-bdfe-4b938a36bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:38.201025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25534-ec42-415c-bdfe-4b938a36bf14 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:38.201311 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25534-ec42-415c-bdfe-4b938a36bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:38.201586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25534-ec42-415c-bdfe-4b938a36bf14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:38.202347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad25534-ec42-415c-bdfe-4b938a36bf14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:38.204269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad25534-ec42-415c-bdfe-4b938a36bf14 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:38.275538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 886/1774] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:38 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:17:38.280864 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bc45f-d025-469d-82c6-e3e36c71bc8e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:38.297181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bc45f-d025-469d-82c6-e3e36c71bc8e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:38.474222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e67d4-fed7-4b46-97db-6b53aaa69873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:38.477520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e67d4-fed7-4b46-97db-6b53aaa69873 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:38.478562 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e67d4-fed7-4b46-97db-6b53aaa69873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:38.478562 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e67d4-fed7-4b46-97db-6b53aaa69873 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:38.480675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e67d4-fed7-4b46-97db-6b53aaa69873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:38.489442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e67d4-fed7-4b46-97db-6b53aaa69873 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:38.537627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 889/1775] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:38 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:38.541838 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad25534-ec42-415c-bdfe-4b938a36bf14 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:38.572962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad25534-ec42-415c-bdfe-4b938a36bf14 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:38.592795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedbaaa-13bd-4ed0-af8a-de1a170220d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:38.595936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedbaaa-13bd-4ed0-af8a-de1a170220d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:38.596228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedbaaa-13bd-4ed0-af8a-de1a170220d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:38.596509 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedbaaa-13bd-4ed0-af8a-de1a170220d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:38.597639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedbaaa-13bd-4ed0-af8a-de1a170220d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:38.605850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedbaaa-13bd-4ed0-af8a-de1a170220d6 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:38.664838 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e67d4-fed7-4b46-97db-6b53aaa69873 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:38.667731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 887/1776] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:38.703471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e67d4-fed7-4b46-97db-6b53aaa69873 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:38.746656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb3d66-ebbc-482b-be81-24aef02cbbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:38.750685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb3d66-ebbc-482b-be81-24aef02cbbc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:38.753312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb3d66-ebbc-482b-be81-24aef02cbbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:38.755194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb3d66-ebbc-482b-be81-24aef02cbbc0 admin admin] PATH_INFO: `/v3/projects/25d85fae8e034ef9971809fa86328ee3/users/2961a9fb592f48b18bc1a0fbb93781d8/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:38.772715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedbaaa-13bd-4ed0-af8a-de1a170220d6 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:38.774571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6cedbaaa-13bd-4ed0-af8a-de1a170220d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:38.794796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedbaaa-13bd-4ed0-af8a-de1a170220d6 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:38.808659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb3d66-ebbc-482b-be81-24aef02cbbc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d85fae8e034ef9971809fa86328ee3, user_id=2961a9fb592f48b18bc1a0fbb93781d8, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:38.811513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e255dd-699d-4807-aaba-bfa0a75fa8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:38.812590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e255dd-699d-4807-aaba-bfa0a75fa8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:38.812874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e255dd-699d-4807-aaba-bfa0a75fa8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:38.813148 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e255dd-699d-4807-aaba-bfa0a75fa8f4 admin admin] PATH_INFO: `/v3/users/7e5745c2d3ca456a86dd5d9054d64670` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:38.816206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e255dd-699d-4807-aaba-bfa0a75fa8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5745c2d3ca456a86dd5d9054d64670)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:38.818156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e255dd-699d-4807-aaba-bfa0a75fa8f4 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:38.822611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb3d66-ebbc-482b-be81-24aef02cbbc0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:38.831608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:38.850584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 890/1777] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:38 2022] PUT /identity/v3/projects/25d85fae8e034ef9971809fa86328ee3/users/2961a9fb592f48b18bc1a0fbb93781d8/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:38.869866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb3d66-ebbc-482b-be81-24aef02cbbc0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:38.960150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e7e255dd-699d-4807-aaba-bfa0a75fa8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5745c2d3ca456a86dd5d9054d64670'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:38.961494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e7e255dd-699d-4807-aaba-bfa0a75fa8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5745c2d3ca456a86dd5d9054d64670'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:38.983648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e7e255dd-699d-4807-aaba-bfa0a75fa8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5745c2d3ca456a86dd5d9054d64670'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:39.019301 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e7e255dd-699d-4807-aaba-bfa0a75fa8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5745c2d3ca456a86dd5d9054d64670'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:39.071037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e7e255dd-699d-4807-aaba-bfa0a75fa8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5745c2d3ca456a86dd5d9054d64670'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:39.084710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 888/1778] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:38 2022] DELETE /identity/v3/users/7e5745c2d3ca456a86dd5d9054d64670 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:17:39.087988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43bde4-afca-4b6a-ab84-b9b9f63c81a1 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:39.088550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43bde4-afca-4b6a-ab84-b9b9f63c81a1 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:39.089033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43bde4-afca-4b6a-ab84-b9b9f63c81a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:39.117762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-9b43bde4-afca-4b6a-ab84-b9b9f63c81a1 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:39.119397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9b43bde4-afca-4b6a-ab84-b9b9f63c81a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:39.141596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:39.149953 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb3d66-ebbc-482b-be81-24aef02cbbc0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:39.267383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 889/1779] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:39.281104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43bde4-afca-4b6a-ab84-b9b9f63c81a1 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:39.284214 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9b43bde4-afca-4b6a-ab84-b9b9f63c81a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:39.398568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2767-25b0-406f-9bd6-ee7d9d48f88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:39.399579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2767-25b0-406f-9bd6-ee7d9d48f88a admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:39.400060 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2767-25b0-406f-9bd6-ee7d9d48f88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:39.403197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2767-25b0-406f-9bd6-ee7d9d48f88a admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:39.405673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc2767-25b0-406f-9bd6-ee7d9d48f88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:39.408480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc2767-25b0-406f-9bd6-ee7d9d48f88a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:39.444419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43bde4-afca-4b6a-ab84-b9b9f63c81a1 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:39.452718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 891/1780] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 586 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:39.453230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec7750-402c-4927-821e-58883e928edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:39.453842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec7750-402c-4927-821e-58883e928edb service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:39.456471 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec7750-402c-4927-821e-58883e928edb service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:39.456803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec7750-402c-4927-821e-58883e928edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:39.457264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2767-25b0-406f-9bd6-ee7d9d48f88a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:39.461081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a2cc2767-25b0-406f-9bd6-ee7d9d48f88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:39.479835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec7750-402c-4927-821e-58883e928edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:39.483139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec7750-402c-4927-821e-58883e928edb service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:39.509051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 890/1781] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:17:39.511007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2767-25b0-406f-9bd6-ee7d9d48f88a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:39.531747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8803a-2788-4764-80ba-46f8f454daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:39.535435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8803a-2788-4764-80ba-46f8f454daf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:39.539964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8803a-2788-4764-80ba-46f8f454daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:39.540575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8803a-2788-4764-80ba-46f8f454daf4 admin admin] PATH_INFO: `/v3/projects/25d85fae8e034ef9971809fa86328ee3/users/2961a9fb592f48b18bc1a0fbb93781d8/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:39.546432 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8803a-2788-4764-80ba-46f8f454daf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d85fae8e034ef9971809fa86328ee3, user_id=2961a9fb592f48b18bc1a0fbb93781d8, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:39.557057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8803a-2788-4764-80ba-46f8f454daf4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:39.635110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec7750-402c-4927-821e-58883e928edb service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:39.637248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-69ec7750-402c-4927-821e-58883e928edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:39.651469 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 892/1782] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:39 2022] PUT /identity/v3/projects/25d85fae8e034ef9971809fa86328ee3/users/2961a9fb592f48b18bc1a0fbb93781d8/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:39.659737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f1c3-4531-476f-994f-653815d91489 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:39.660225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f1c3-4531-476f-994f-653815d91489 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:39.661871 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f1c3-4531-476f-994f-653815d91489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:39.671941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec7750-402c-4927-821e-58883e928edb service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:39.723056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:39.751524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4149f1c3-4531-476f-994f-653815d91489 None None] MFA Rules not processed for user `2961a9fb592f48b18bc1a0fbb93781d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:39.757408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4149f1c3-4531-476f-994f-653815d91489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:39.838802 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:39.841374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:39.841374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:39.841658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] PATH_INFO: `/v3/users/4abe008cb0a241f6ab24aa878d511712` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:39.846132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abe008cb0a241f6ab24aa878d511712)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:39.848816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:39.976212 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 893/1783] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:39.979087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275539-99d5-4d68-8f4c-644c74acacf6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:39.980299 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275539-99d5-4d68-8f4c-644c74acacf6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:39.990923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275539-99d5-4d68-8f4c-644c74acacf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:40.031183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abe008cb0a241f6ab24aa878d511712'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:40.035085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abe008cb0a241f6ab24aa878d511712'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:40.071649 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abe008cb0a241f6ab24aa878d511712'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:40.076107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6c275539-99d5-4d68-8f4c-644c74acacf6 None None] MFA Rules not processed for user `1dd219b5b23c454c8279169367d23e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:40.079525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6c275539-99d5-4d68-8f4c-644c74acacf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:40.088073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abe008cb0a241f6ab24aa878d511712'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:40.124526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abe008cb0a241f6ab24aa878d511712'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:40.152259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 891/1784] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:39 2022] DELETE /identity/v3/users/4abe008cb0a241f6ab24aa878d511712 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:17:40.155077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:40.157552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:40.260089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 894/1785] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:40.262413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59904ad-20c7-4cfa-8494-8402095462f4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:40.262981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59904ad-20c7-4cfa-8494-8402095462f4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:40.263517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59904ad-20c7-4cfa-8494-8402095462f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:40.279722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:40.318681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a59904ad-20c7-4cfa-8494-8402095462f4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:40.323065 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a59904ad-20c7-4cfa-8494-8402095462f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:40.373333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce799db4-d554-4425-9ed5-c5a3a0769644 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:40.383239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fd87a-83dc-41ef-8b57-43781a7fba77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:40.384200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fd87a-83dc-41ef-8b57-43781a7fba77 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:40.384661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fd87a-83dc-41ef-8b57-43781a7fba77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:40.384940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fd87a-83dc-41ef-8b57-43781a7fba77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:40.388668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-443fd87a-83dc-41ef-8b57-43781a7fba77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:40.509579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 895/1786] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:40.524938 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136a0fa-3c3b-45e3-84da-56ad53003b37 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:40.527240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136a0fa-3c3b-45e3-84da-56ad53003b37 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:40.527941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136a0fa-3c3b-45e3-84da-56ad53003b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:40.551436 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:40.556745 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fd87a-83dc-41ef-8b57-43781a7fba77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:40.559118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fd87a-83dc-41ef-8b57-43781a7fba77 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:40.574735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8136a0fa-3c3b-45e3-84da-56ad53003b37 None None] MFA Rules not processed for user `72f981c1a18d4460b7400036bb5d2e31`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:40.576284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8136a0fa-3c3b-45e3-84da-56ad53003b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:40.594846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 892/1787] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:40.596368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fd87a-83dc-41ef-8b57-43781a7fba77 service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:40.599135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-443fd87a-83dc-41ef-8b57-43781a7fba77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:40.743023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 896/1788] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:40.744134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136a0fa-3c3b-45e3-84da-56ad53003b37 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:40.745910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8136a0fa-3c3b-45e3-84da-56ad53003b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:40.858014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fd87a-83dc-41ef-8b57-43781a7fba77 service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:40.880329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7690cf-ebc4-480b-9c4a-8c748975abe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:40.881406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7690cf-ebc4-480b-9c4a-8c748975abe8 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:40.881737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7690cf-ebc4-480b-9c4a-8c748975abe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:40.882013 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7690cf-ebc4-480b-9c4a-8c748975abe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:40.945127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136a0fa-3c3b-45e3-84da-56ad53003b37 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:40.965520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e2056-a213-4049-a0ec-df5c73988766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:40.966237 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e2056-a213-4049-a0ec-df5c73988766 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:40.966931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e2056-a213-4049-a0ec-df5c73988766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:40.966931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e2056-a213-4049-a0ec-df5c73988766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:40.995365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e2056-a213-4049-a0ec-df5c73988766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:40.996821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e2056-a213-4049-a0ec-df5c73988766 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:41.017891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7690cf-ebc4-480b-9c4a-8c748975abe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:41.022337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7690cf-ebc4-480b-9c4a-8c748975abe8 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:41.030729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 897/1789] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:41.031620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e2056-a213-4049-a0ec-df5c73988766 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:41.037429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a79e2056-a213-4049-a0ec-df5c73988766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:41.045474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 893/1790] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:41.048500 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7690cf-ebc4-480b-9c4a-8c748975abe8 service nova] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:41.059215 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7690cf-ebc4-480b-9c4a-8c748975abe8 service nova] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:41.063999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d29d8-4298-4435-81d1-44a7a041041b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:41.065157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d29d8-4298-4435-81d1-44a7a041041b service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:41.065819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d29d8-4298-4435-81d1-44a7a041041b service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:41.067079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d29d8-4298-4435-81d1-44a7a041041b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:41.069202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c93d29d8-4298-4435-81d1-44a7a041041b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:41.086172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e2056-a213-4049-a0ec-df5c73988766 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:41.113023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:41.114270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:41.114768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:41.115220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] PATH_INFO: `/v3/projects/3360c689de944b38a25702d29e1d8746` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:41.117127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3360c689de944b38a25702d29e1d8746)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:41.122161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:41.281885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:41.290620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3360c689de944b38a25702d29e1d8746', 'request_id': 'req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:41.317744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3360c689de944b38a25702d29e1d8746', 'request_id': 'req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:41.330639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d29d8-4298-4435-81d1-44a7a041041b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:41.339438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d29d8-4298-4435-81d1-44a7a041041b service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:41.354560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3360c689de944b38a25702d29e1d8746', 'request_id': 'req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:41.375864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 894/1791] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:41.378922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] The token cache is being invalidate because project 3360c689de944b38a25702d29e1d8746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:41.379589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:41.381355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bd81774f-3d7b-4ca4-8e1c-33c10f3da8f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:41.386110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 898/1792] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:41 2022] DELETE /identity/v3/projects/3360c689de944b38a25702d29e1d8746 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:41.391252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953a49-657c-430f-b04c-add8412950fd None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:41.391814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953a49-657c-430f-b04c-add8412950fd None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:41.392322 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953a49-657c-430f-b04c-add8412950fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:41.435949 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-b0953a49-657c-430f-b04c-add8412950fd None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:41.441594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b0953a49-657c-430f-b04c-add8412950fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:41.548496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:41.790492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 895/1793] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:41.800278 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844dd87-dabc-44b0-9c07-f93715c23583 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:41.800673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844dd87-dabc-44b0-9c07-f93715c23583 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:41.801041 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844dd87-dabc-44b0-9c07-f93715c23583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:41.847497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e844dd87-dabc-44b0-9c07-f93715c23583 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:41.859320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e844dd87-dabc-44b0-9c07-f93715c23583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:41.915797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 899/1794] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:41.920376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0953a49-657c-430f-b04c-add8412950fd None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:41.937290 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0953a49-657c-430f-b04c-add8412950fd None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:41.964139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740130c-3720-4a38-bf23-f93149efdf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:41.965141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740130c-3720-4a38-bf23-f93149efdf94 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:41.965425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740130c-3720-4a38-bf23-f93149efdf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:41.965699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740130c-3720-4a38-bf23-f93149efdf94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:41.966872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740130c-3720-4a38-bf23-f93149efdf94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:41.967176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740130c-3720-4a38-bf23-f93149efdf94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:41.970846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740130c-3720-4a38-bf23-f93149efdf94 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:42.033543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 896/1795] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:42.035406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844dd87-dabc-44b0-9c07-f93715c23583 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:42.077036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844dd87-dabc-44b0-9c07-f93715c23583 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:42.089052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f66b6a-684e-490b-9540-16cf38648cd3 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:42.089572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f66b6a-684e-490b-9540-16cf38648cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:42.089572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f66b6a-684e-490b-9540-16cf38648cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:42.122807 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9729ab7-9cee-454f-b302-ad799f3ae09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:42.123620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729ab7-9cee-454f-b302-ad799f3ae09f admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:42.123906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729ab7-9cee-454f-b302-ad799f3ae09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:42.125740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729ab7-9cee-454f-b302-ad799f3ae09f admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:42.130893 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9729ab7-9cee-454f-b302-ad799f3ae09f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:42.139583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9729ab7-9cee-454f-b302-ad799f3ae09f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:42.170974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-67f66b6a-684e-490b-9540-16cf38648cd3 None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:42.172572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-67f66b6a-684e-490b-9540-16cf38648cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:42.243192 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 900/1796] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:42 2022] POST /identity/v3/projects => generated 399 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:42.249791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9729ab7-9cee-454f-b302-ad799f3ae09f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:42.393302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 897/1797] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:17:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:42.459655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9729ab7-9cee-454f-b302-ad799f3ae09f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:42.466331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93750a-edc2-42af-8d31-4410e1fc7d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:42.467233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93750a-edc2-42af-8d31-4410e1fc7d6b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:42.467661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93750a-edc2-42af-8d31-4410e1fc7d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:42.468425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93750a-edc2-42af-8d31-4410e1fc7d6b admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:42.469884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93750a-edc2-42af-8d31-4410e1fc7d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:42.473814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93750a-edc2-42af-8d31-4410e1fc7d6b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:42.524358 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f66b6a-684e-490b-9540-16cf38648cd3 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:42.524628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 901/1798] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:42 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:17:42.534739 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f66b6a-684e-490b-9540-16cf38648cd3 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:42.539839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23711-3a0e-4da6-9efc-2cfa6fea50d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:42.540530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23711-3a0e-4da6-9efc-2cfa6fea50d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:42.540964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23711-3a0e-4da6-9efc-2cfa6fea50d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:42.541786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23711-3a0e-4da6-9efc-2cfa6fea50d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:42.542892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b23711-3a0e-4da6-9efc-2cfa6fea50d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:42.546490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b23711-3a0e-4da6-9efc-2cfa6fea50d6 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:42.575056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 898/1799] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:17:42.581571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93750a-edc2-42af-8d31-4410e1fc7d6b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:42.596280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93750a-edc2-42af-8d31-4410e1fc7d6b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:42.603674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f69f2-8a21-42fd-98ae-485457e3961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:42.604581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f69f2-8a21-42fd-98ae-485457e3961d admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:42.605003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f69f2-8a21-42fd-98ae-485457e3961d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:42.605457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f69f2-8a21-42fd-98ae-485457e3961d admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:42.606538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f69f2-8a21-42fd-98ae-485457e3961d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:42.609298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f69f2-8a21-42fd-98ae-485457e3961d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:42.683955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23711-3a0e-4da6-9efc-2cfa6fea50d6 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:42.684992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 902/1800] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:42.728534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23711-3a0e-4da6-9efc-2cfa6fea50d6 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:42.740222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0d849-ead7-4f3a-a162-00dee9455ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:42.742515 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0d849-ead7-4f3a-a162-00dee9455ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:42.744290 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0d849-ead7-4f3a-a162-00dee9455ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:42.746647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0d849-ead7-4f3a-a162-00dee9455ca1 admin admin] PATH_INFO: `/v3/projects/8cd4357e046d431d8caae8eb2335efcc/users/66d609ddddfd403c98e1d19e918eb00a/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:42.786241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f69f2-8a21-42fd-98ae-485457e3961d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:42.788830 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cd8f69f2-8a21-42fd-98ae-485457e3961d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:42.842783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0d849-ead7-4f3a-a162-00dee9455ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd4357e046d431d8caae8eb2335efcc, user_id=66d609ddddfd403c98e1d19e918eb00a, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:42.853093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0d849-ead7-4f3a-a162-00dee9455ca1 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:42.903062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 899/1801] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:42 2022] PUT /identity/v3/projects/8cd4357e046d431d8caae8eb2335efcc/users/66d609ddddfd403c98e1d19e918eb00a/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:42.921639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f5e9a-6923-4ce2-bd24-d14b20064bcc None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:42.921981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f5e9a-6923-4ce2-bd24-d14b20064bcc None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:42.922264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f5e9a-6923-4ce2-bd24-d14b20064bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:43.086829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e32f5e9a-6923-4ce2-bd24-d14b20064bcc None None] MFA Rules not processed for user `66d609ddddfd403c98e1d19e918eb00a`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:43.091314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e32f5e9a-6923-4ce2-bd24-d14b20064bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:43.158617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f69f2-8a21-42fd-98ae-485457e3961d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:43.288957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:43.346392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 900/1802] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:43.348707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f5e9a-6923-4ce2-bd24-d14b20064bcc None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:43.412029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:43.459265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925fade-9675-4d58-acca-748ce68cad5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:43.460099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925fade-9675-4d58-acca-748ce68cad5e service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:43.472782 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925fade-9675-4d58-acca-748ce68cad5e service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:43.473968 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925fade-9675-4d58-acca-748ce68cad5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:43.662535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f5e9a-6923-4ce2-bd24-d14b20064bcc None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:43.711951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f363a-958e-4459-8659-4a6ef71a3f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:43.713662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f363a-958e-4459-8659-4a6ef71a3f7e admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:43.716615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f363a-958e-4459-8659-4a6ef71a3f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:43.717731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f363a-958e-4459-8659-4a6ef71a3f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:43.719934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f363a-958e-4459-8659-4a6ef71a3f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:43.743098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f363a-958e-4459-8659-4a6ef71a3f7e admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:43.757792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925fade-9675-4d58-acca-748ce68cad5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:43.774208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925fade-9675-4d58-acca-748ce68cad5e service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:43.822346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 903/1803] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:17:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1037 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:17:43.849892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925fade-9675-4d58-acca-748ce68cad5e service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:43.854945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d925fade-9675-4d58-acca-748ce68cad5e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:43.925829 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925fade-9675-4d58-acca-748ce68cad5e service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:43.942443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 901/1804] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:43 2022] POST /identity/v3/projects => generated 399 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:43.945372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f363a-958e-4459-8659-4a6ef71a3f7e admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:44.246178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f363a-958e-4459-8659-4a6ef71a3f7e admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:44.262801 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fb98f-f084-48c4-8873-88e0c493dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:44.265376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb98f-f084-48c4-8873-88e0c493dd41 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:44.267956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb98f-f084-48c4-8873-88e0c493dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:44.269041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb98f-f084-48c4-8873-88e0c493dd41 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:44.271280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fb98f-f084-48c4-8873-88e0c493dd41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:44.281460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fb98f-f084-48c4-8873-88e0c493dd41 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:44.344819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 902/1805] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:43 2022] POST /identity/v3/users => generated 306 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:44.352741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fb98f-f084-48c4-8873-88e0c493dd41 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:44.374982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:44.375904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:44.376188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:44.376530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] PATH_INFO: `/v3/projects/e732571454b9414688e9a0ce751c4c6b` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:44.385743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fb98f-f084-48c4-8873-88e0c493dd41 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:44.392938 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e732571454b9414688e9a0ce751c4c6b)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:44.406952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafb4d1-67a9-4e2b-b7e1-55c00c332c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:44.407810 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb4d1-67a9-4e2b-b7e1-55c00c332c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:44.408064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb4d1-67a9-4e2b-b7e1-55c00c332c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:44.408418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb4d1-67a9-4e2b-b7e1-55c00c332c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:44.409205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafb4d1-67a9-4e2b-b7e1-55c00c332c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:44.410868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafb4d1-67a9-4e2b-b7e1-55c00c332c92 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:44.412265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:44.462472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 903/1806] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:17:44.468425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafb4d1-67a9-4e2b-b7e1-55c00c332c92 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:44.493869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafb4d1-67a9-4e2b-b7e1-55c00c332c92 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:44.517427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acef62-59f3-4728-bb4d-0119177bb809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:44.520267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acef62-59f3-4728-bb4d-0119177bb809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:44.522119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acef62-59f3-4728-bb4d-0119177bb809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:44.526576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acef62-59f3-4728-bb4d-0119177bb809 admin admin] PATH_INFO: `/v3/projects/e0dffbe226954d38a4e73c7c9177800a/users/dfa131a69b0341dfa12d91924b5c0647/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:44.591172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e732571454b9414688e9a0ce751c4c6b', 'request_id': 'req-a73abe59-8cfd-41ab-b764-8d8de17a668a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:44.602278 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e732571454b9414688e9a0ce751c4c6b', 'request_id': 'req-a73abe59-8cfd-41ab-b764-8d8de17a668a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:44.613935 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acef62-59f3-4728-bb4d-0119177bb809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0dffbe226954d38a4e73c7c9177800a, user_id=dfa131a69b0341dfa12d91924b5c0647, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:44.622624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e732571454b9414688e9a0ce751c4c6b', 'request_id': 'req-a73abe59-8cfd-41ab-b764-8d8de17a668a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:44.627107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acef62-59f3-4728-bb4d-0119177bb809 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:44.635075 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:44.642211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] The token cache is being invalidate because project e732571454b9414688e9a0ce751c4c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:44.643384 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:44.644564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:44.654944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 904/1807] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:43 2022] DELETE /identity/v3/projects/e732571454b9414688e9a0ce751c4c6b => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:44.662426 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:44.668376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:44.711231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 904/1808] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:44 2022] PUT /identity/v3/projects/e0dffbe226954d38a4e73c7c9177800a/users/dfa131a69b0341dfa12d91924b5c0647/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:44.715499 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acef62-59f3-4728-bb4d-0119177bb809 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:44.733016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c4acef62-59f3-4728-bb4d-0119177bb809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:44.917124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:44.928594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acef62-59f3-4728-bb4d-0119177bb809 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:44.939244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15496d-468c-4075-92cc-a7691edce42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:44.939961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15496d-468c-4075-92cc-a7691edce42f admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:44.940600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15496d-468c-4075-92cc-a7691edce42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:44.940897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15496d-468c-4075-92cc-a7691edce42f admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:44.941653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15496d-468c-4075-92cc-a7691edce42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:44.946633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15496d-468c-4075-92cc-a7691edce42f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:44.954477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73abe59-8cfd-41ab-b764-8d8de17a668a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:44.978664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:44.980068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:44.980508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:44.980936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] PATH_INFO: `/v3/users/0f5e0a091697437ca8bffbb5e9173799` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:44.984437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5e0a091697437ca8bffbb5e9173799)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:44.989318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:45.005107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 905/1809] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:17:45.008450 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15496d-468c-4075-92cc-a7691edce42f admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:45.027500 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15496d-468c-4075-92cc-a7691edce42f admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:45.035380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fef0a-e826-431a-9c9a-5117b4d91448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:45.036601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fef0a-e826-431a-9c9a-5117b4d91448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:45.037114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fef0a-e826-431a-9c9a-5117b4d91448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:45.037463 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fef0a-e826-431a-9c9a-5117b4d91448 admin admin] PATH_INFO: `/v3/projects/e0dffbe226954d38a4e73c7c9177800a/users/dfa131a69b0341dfa12d91924b5c0647/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:45.039948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fef0a-e826-431a-9c9a-5117b4d91448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0dffbe226954d38a4e73c7c9177800a, user_id=dfa131a69b0341dfa12d91924b5c0647, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:45.052401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fef0a-e826-431a-9c9a-5117b4d91448 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:45.111339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 906/1810] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:45 2022] PUT /identity/v3/projects/e0dffbe226954d38a4e73c7c9177800a/users/dfa131a69b0341dfa12d91924b5c0647/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:17:45.120299 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a76cc4-4468-4a0d-a40d-2c4fabf83dc2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:45.123331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a76cc4-4468-4a0d-a40d-2c4fabf83dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:45.123674 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a76cc4-4468-4a0d-a40d-2c4fabf83dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:45.124512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5e0a091697437ca8bffbb5e9173799'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:45.125387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5e0a091697437ca8bffbb5e9173799'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:45.149605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5e0a091697437ca8bffbb5e9173799'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:45.185208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5e0a091697437ca8bffbb5e9173799'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:45.220399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5e0a091697437ca8bffbb5e9173799'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:45.238176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-c2a76cc4-4468-4a0d-a40d-2c4fabf83dc2 None None] MFA Rules not processed for user `dfa131a69b0341dfa12d91924b5c0647`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:45.242533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 905/1811] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:44 2022] DELETE /identity/v3/users/0f5e0a091697437ca8bffbb5e9173799 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:45.244827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c2a76cc4-4468-4a0d-a40d-2c4fabf83dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:45.496499 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 907/1812] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:45.558393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:45.563843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:45.827148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3f162-c996-45d2-a018-e63781a1ab7e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:45.832874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246d19e-04a9-4fe6-b6dc-457ca157ea23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:45.834554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246d19e-04a9-4fe6-b6dc-457ca157ea23 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:45.834973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246d19e-04a9-4fe6-b6dc-457ca157ea23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:45.835351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246d19e-04a9-4fe6-b6dc-457ca157ea23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:45.851073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246d19e-04a9-4fe6-b6dc-457ca157ea23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:45.853493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246d19e-04a9-4fe6-b6dc-457ca157ea23 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:45.867788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 906/1813] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:45 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:46.037892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a76cc4-4468-4a0d-a40d-2c4fabf83dc2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:46.052889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a76cc4-4468-4a0d-a40d-2c4fabf83dc2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:46.070485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77e2e9-a122-4623-aa2f-df963997ad16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:46.071769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e2e9-a122-4623-aa2f-df963997ad16 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:46.071769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e2e9-a122-4623-aa2f-df963997ad16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:46.071973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e2e9-a122-4623-aa2f-df963997ad16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:46.080955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8e77e2e9-a122-4623-aa2f-df963997ad16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:46.292952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77e2e9-a122-4623-aa2f-df963997ad16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:46.294796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77e2e9-a122-4623-aa2f-df963997ad16 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:46.325410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 908/1814] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:48.134823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0a99b-226b-492d-b895-21e66b03acd8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:48.135455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0a99b-226b-492d-b895-21e66b03acd8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:48.135455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0a99b-226b-492d-b895-21e66b03acd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:48.170684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1cc0a99b-226b-492d-b895-21e66b03acd8 None None] MFA Rules not processed for user `d7e0632bc12346b38663a0ef97ab1a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:48.172019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1cc0a99b-226b-492d-b895-21e66b03acd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:48.224446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:48.317536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 907/1815] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Jun 28 03:17:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:48.439486 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77e2e9-a122-4623-aa2f-df963997ad16 service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:48.443611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8e77e2e9-a122-4623-aa2f-df963997ad16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:48.450109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0a99b-226b-492d-b895-21e66b03acd8 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:48.463359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0a99b-226b-492d-b895-21e66b03acd8 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:48.479377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b88be-0721-4a2a-9a1e-1fe837e21a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:48.481417 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77e2e9-a122-4623-aa2f-df963997ad16 service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:48.482202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b88be-0721-4a2a-9a1e-1fe837e21a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:48.485013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b88be-0721-4a2a-9a1e-1fe837e21a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:48.485937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b88be-0721-4a2a-9a1e-1fe837e21a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:48.529098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ebd7f-d7e5-43f4-98ad-61c2cfe17be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:48.532772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ebd7f-d7e5-43f4-98ad-61c2cfe17be6 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:48.535878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ebd7f-d7e5-43f4-98ad-61c2cfe17be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:48.536780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ebd7f-d7e5-43f4-98ad-61c2cfe17be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:48.553196 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b88be-0721-4a2a-9a1e-1fe837e21a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:48.555360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b88be-0721-4a2a-9a1e-1fe837e21a66 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:48.568742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ebd7f-d7e5-43f4-98ad-61c2cfe17be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:48.578821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ebd7f-d7e5-43f4-98ad-61c2cfe17be6 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:48.599304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 908/1816] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:17:48.609888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 909/1817] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:51.906721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b88be-0721-4a2a-9a1e-1fe837e21a66 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:51.909327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-523b88be-0721-4a2a-9a1e-1fe837e21a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:52.020235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa67f6-0109-4f8c-9b0b-628708933ccd None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:52.020733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa67f6-0109-4f8c-9b0b-628708933ccd None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:52.020861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa67f6-0109-4f8c-9b0b-628708933ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:52.089142 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8ffa67f6-0109-4f8c-9b0b-628708933ccd None None] MFA Rules not processed for user `1dd219b5b23c454c8279169367d23e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:52.093265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8ffa67f6-0109-4f8c-9b0b-628708933ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:52.172813 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b88be-0721-4a2a-9a1e-1fe837e21a66 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:52.192665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:52.193607 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:52.193891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:52.194167 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] PATH_INFO: `/v3/projects/4d59b95956da49f58006ebad509afae5` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:52.199161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d59b95956da49f58006ebad509afae5)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:52.207565 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:52.264623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:52.302947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 910/1818] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:52.380397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d59b95956da49f58006ebad509afae5', 'request_id': 'req-b4181250-1bb2-4564-a6f1-6999fc032156'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:52.408927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d59b95956da49f58006ebad509afae5', 'request_id': 'req-b4181250-1bb2-4564-a6f1-6999fc032156'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:52.426678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d59b95956da49f58006ebad509afae5', 'request_id': 'req-b4181250-1bb2-4564-a6f1-6999fc032156'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:52.471625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] The token cache is being invalidate because project 4d59b95956da49f58006ebad509afae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:52.472618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:52.473601 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b4181250-1bb2-4564-a6f1-6999fc032156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:52.477063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 909/1819] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:51 2022] DELETE /identity/v3/projects/4d59b95956da49f58006ebad509afae5 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:52.481471 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d702-d213-423b-8af3-4171732bc11f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:52.481763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d702-d213-423b-8af3-4171732bc11f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:52.482045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d702-d213-423b-8af3-4171732bc11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:52.507047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb97f7-dbcb-4236-8a1b-542e78e5a0bb None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:52.507335 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb97f7-dbcb-4236-8a1b-542e78e5a0bb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:52.507609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb97f7-dbcb-4236-8a1b-542e78e5a0bb None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:52.510634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 910/1820] 10.222.0.23 () {54 vars in 921 bytes} [Tue Jun 28 03:17:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:17:52.550806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8a45d702-d213-423b-8af3-4171732bc11f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:52.558793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8a45d702-d213-423b-8af3-4171732bc11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:52.624277 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3788d78-4cfc-445f-8fe7-28896795b11a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:52.624471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3788d78-4cfc-445f-8fe7-28896795b11a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:52.624754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3788d78-4cfc-445f-8fe7-28896795b11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:52.663225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b3788d78-4cfc-445f-8fe7-28896795b11a None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:52.664444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b3788d78-4cfc-445f-8fe7-28896795b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:52.785971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 911/1821] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:52.790445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d702-d213-423b-8af3-4171732bc11f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:52.799817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8a45d702-d213-423b-8af3-4171732bc11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:52.828820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:52.884399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d702-d213-423b-8af3-4171732bc11f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:52.899831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a471f-031f-4921-ba4a-1e3c6bb0d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:52.913263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 911/1822] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Jun 28 03:17:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:52.914559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc162e3-4bd5-42bc-8803-847990785e06 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:52.914846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc162e3-4bd5-42bc-8803-847990785e06 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:52.915124 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc162e3-4bd5-42bc-8803-847990785e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:52.918236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a471f-031f-4921-ba4a-1e3c6bb0d7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:52.922285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a471f-031f-4921-ba4a-1e3c6bb0d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:52.922867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a471f-031f-4921-ba4a-1e3c6bb0d7dc admin admin] PATH_INFO: `/v3/users/66d609ddddfd403c98e1d19e918eb00a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:52.927952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a471f-031f-4921-ba4a-1e3c6bb0d7dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d609ddddfd403c98e1d19e918eb00a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:52.930630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a471f-031f-4921-ba4a-1e3c6bb0d7dc admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:52.949077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3bc162e3-4bd5-42bc-8803-847990785e06 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:52.950734 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3bc162e3-4bd5-42bc-8803-847990785e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:52.968266 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 912/1823] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:52.970829 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc162e3-4bd5-42bc-8803-847990785e06 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:53.007301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc162e3-4bd5-42bc-8803-847990785e06 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:53.017364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4588-72eb-40df-8c86-b9885d4ce1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:53.018857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4588-72eb-40df-8c86-b9885d4ce1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:53.019530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4588-72eb-40df-8c86-b9885d4ce1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:53.020456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4588-72eb-40df-8c86-b9885d4ce1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:53.021815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d4588-72eb-40df-8c86-b9885d4ce1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:53.022385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d4588-72eb-40df-8c86-b9885d4ce1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:53.025821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d4588-72eb-40df-8c86-b9885d4ce1c2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:53.038618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-a70a471f-031f-4921-ba4a-1e3c6bb0d7dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d609ddddfd403c98e1d19e918eb00a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:53.040651 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-a70a471f-031f-4921-ba4a-1e3c6bb0d7dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d609ddddfd403c98e1d19e918eb00a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:53.044827 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 913/1824] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:17:53.050141 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4588-72eb-40df-8c86-b9885d4ce1c2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:53.055305 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-a70a471f-031f-4921-ba4a-1e3c6bb0d7dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d609ddddfd403c98e1d19e918eb00a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:53.068091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-a70a471f-031f-4921-ba4a-1e3c6bb0d7dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d609ddddfd403c98e1d19e918eb00a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:53.083236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4588-72eb-40df-8c86-b9885d4ce1c2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:53.102650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed4ad9-a6bb-4015-ac6f-c8f216f096da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:53.103079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed4ad9-a6bb-4015-ac6f-c8f216f096da admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:53.103222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed4ad9-a6bb-4015-ac6f-c8f216f096da admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:53.105916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-a70a471f-031f-4921-ba4a-1e3c6bb0d7dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d609ddddfd403c98e1d19e918eb00a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:53.107259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed4ad9-a6bb-4015-ac6f-c8f216f096da admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:53.108209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed4ad9-a6bb-4015-ac6f-c8f216f096da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:53.113267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed4ad9-a6bb-4015-ac6f-c8f216f096da admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:53.125737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 912/1825] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:52 2022] DELETE /identity/v3/users/66d609ddddfd403c98e1d19e918eb00a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:53.131124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55670a18-7488-47ad-b94c-7be5fbd0c75c None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:53.131605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55670a18-7488-47ad-b94c-7be5fbd0c75c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:53.132033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55670a18-7488-47ad-b94c-7be5fbd0c75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:53.177472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 914/1826] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:53 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:53.181523 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed4ad9-a6bb-4015-ac6f-c8f216f096da admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:53.184061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6bed4ad9-a6bb-4015-ac6f-c8f216f096da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:53.191700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-55670a18-7488-47ad-b94c-7be5fbd0c75c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:53.192975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-55670a18-7488-47ad-b94c-7be5fbd0c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:53.343568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed4ad9-a6bb-4015-ac6f-c8f216f096da admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:53.357230 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e479110-e308-4529-81f9-d9dba5a0346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:53.357939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e479110-e308-4529-81f9-d9dba5a0346b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:53.358270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e479110-e308-4529-81f9-d9dba5a0346b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:53.358518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e479110-e308-4529-81f9-d9dba5a0346b admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:53.359228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e479110-e308-4529-81f9-d9dba5a0346b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:53.360846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 913/1827] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:53.361477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e479110-e308-4529-81f9-d9dba5a0346b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:53.428844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 915/1828] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:53 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:53.431406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55670a18-7488-47ad-b94c-7be5fbd0c75c None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:53.447854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e479110-e308-4529-81f9-d9dba5a0346b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:53.453396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8e479110-e308-4529-81f9-d9dba5a0346b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:53.454921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55670a18-7488-47ad-b94c-7be5fbd0c75c None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:53.477071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f709b-dc12-4ca6-a848-67cac67440fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:53.479879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f709b-dc12-4ca6-a848-67cac67440fe admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:53.482328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f709b-dc12-4ca6-a848-67cac67440fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:53.484643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f709b-dc12-4ca6-a848-67cac67440fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:53.486071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f709b-dc12-4ca6-a848-67cac67440fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:53.493048 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f709b-dc12-4ca6-a848-67cac67440fe admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:53.498905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:53.530241 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 914/1829] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:17:53.531493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f709b-dc12-4ca6-a848-67cac67440fe admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:53.551308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f709b-dc12-4ca6-a848-67cac67440fe admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:53.563238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1c1ce-f1c1-49b6-af0c-780f1828c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:53.564340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1c1ce-f1c1-49b6-af0c-780f1828c300 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:53.564867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1c1ce-f1c1-49b6-af0c-780f1828c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:53.565308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1c1ce-f1c1-49b6-af0c-780f1828c300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:53.566189 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1c1ce-f1c1-49b6-af0c-780f1828c300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:53.568006 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1c1ce-f1c1-49b6-af0c-780f1828c300 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:53.591671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 915/1830] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:53.596298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1c1ce-f1c1-49b6-af0c-780f1828c300 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:53.616796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1c1ce-f1c1-49b6-af0c-780f1828c300 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:53.632019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3abc0e-ab17-4490-bf7e-cbed492aa379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:53.632964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3abc0e-ab17-4490-bf7e-cbed492aa379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:53.633286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3abc0e-ab17-4490-bf7e-cbed492aa379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:53.633501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3abc0e-ab17-4490-bf7e-cbed492aa379 admin admin] PATH_INFO: `/v3/projects/c7ffc360d5ea4eebb0cc27c48060d24d/users/203a7848e4174d56a6f9ac0972ca4c1a/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:53.665222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3abc0e-ab17-4490-bf7e-cbed492aa379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ffc360d5ea4eebb0cc27c48060d24d, user_id=203a7848e4174d56a6f9ac0972ca4c1a, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:53.669092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3abc0e-ab17-4490-bf7e-cbed492aa379 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:53.698281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e479110-e308-4529-81f9-d9dba5a0346b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:53.744332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 916/1831] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:53 2022] PUT /identity/v3/projects/c7ffc360d5ea4eebb0cc27c48060d24d/users/203a7848e4174d56a6f9ac0972ca4c1a/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:53.766612 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de2deb-5933-4443-acf4-da0ec42d46a2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:53.772295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de2deb-5933-4443-acf4-da0ec42d46a2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:53.773629 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de2deb-5933-4443-acf4-da0ec42d46a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:53.855362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:53.893873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e35132-3c97-4ed9-a7aa-0a66ab2e1150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:53.900367 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e35132-3c97-4ed9-a7aa-0a66ab2e1150 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:53.900672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e35132-3c97-4ed9-a7aa-0a66ab2e1150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:53.900958 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e35132-3c97-4ed9-a7aa-0a66ab2e1150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:53.906566 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-27de2deb-5933-4443-acf4-da0ec42d46a2 None None] MFA Rules not processed for user `203a7848e4174d56a6f9ac0972ca4c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:53.909848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-27de2deb-5933-4443-acf4-da0ec42d46a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:54.063144 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e35132-3c97-4ed9-a7aa-0a66ab2e1150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:54.068836 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e35132-3c97-4ed9-a7aa-0a66ab2e1150 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:54.089352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 916/1832] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:54.090453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e35132-3c97-4ed9-a7aa-0a66ab2e1150 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:54.093132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-58e35132-3c97-4ed9-a7aa-0a66ab2e1150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:54.172352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 917/1833] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:54.182700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de2deb-5933-4443-acf4-da0ec42d46a2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:54.214403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e35132-3c97-4ed9-a7aa-0a66ab2e1150 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:54.216601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de2deb-5933-4443-acf4-da0ec42d46a2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:54.232594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9a793-44be-4409-b3a9-867afd66f825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:54.233559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9a793-44be-4409-b3a9-867afd66f825 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:54.234000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9a793-44be-4409-b3a9-867afd66f825 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:54.234631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861518e1-94ad-4547-b7bc-9a8ad5e21070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:54.235634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861518e1-94ad-4547-b7bc-9a8ad5e21070 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:54.236213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861518e1-94ad-4547-b7bc-9a8ad5e21070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:54.236800 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861518e1-94ad-4547-b7bc-9a8ad5e21070 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:54.237725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861518e1-94ad-4547-b7bc-9a8ad5e21070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:54.243428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9a793-44be-4409-b3a9-867afd66f825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:54.244248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861518e1-94ad-4547-b7bc-9a8ad5e21070 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:54.248123 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1ec9a793-44be-4409-b3a9-867afd66f825 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:54.274819 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9a793-44be-4409-b3a9-867afd66f825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:54.276724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9a793-44be-4409-b3a9-867afd66f825 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:54.294575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 917/1834] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:54.315842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 918/1835] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:54 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:54.325189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9a793-44be-4409-b3a9-867afd66f825 service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:54.363516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9a793-44be-4409-b3a9-867afd66f825 service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:54.622427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8998d1d-babd-43f7-a5ec-6bca8e44c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:54.623413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998d1d-babd-43f7-a5ec-6bca8e44c5fc admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:54.623842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998d1d-babd-43f7-a5ec-6bca8e44c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:54.624258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998d1d-babd-43f7-a5ec-6bca8e44c5fc admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:54.625109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8998d1d-babd-43f7-a5ec-6bca8e44c5fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:54.628729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8998d1d-babd-43f7-a5ec-6bca8e44c5fc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:54.681031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 918/1836] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:54 2022] POST /identity/v3/users => generated 302 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:54.685183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861518e1-94ad-4547-b7bc-9a8ad5e21070 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:54.707040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861518e1-94ad-4547-b7bc-9a8ad5e21070 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:54.719060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df0c7b-9f62-4d62-baa8-ed191788a947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:54.720639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df0c7b-9f62-4d62-baa8-ed191788a947 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:54.720639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df0c7b-9f62-4d62-baa8-ed191788a947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:54.720639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df0c7b-9f62-4d62-baa8-ed191788a947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:54.721654 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df0c7b-9f62-4d62-baa8-ed191788a947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:54.724182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df0c7b-9f62-4d62-baa8-ed191788a947 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:54.742139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 919/1837] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:54.751942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8998d1d-babd-43f7-a5ec-6bca8e44c5fc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:54.767932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8998d1d-babd-43f7-a5ec-6bca8e44c5fc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:54.774903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bf499-6c79-4fd7-9ebc-3556d9eb4aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:54.776330 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bf499-6c79-4fd7-9ebc-3556d9eb4aca admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:54.776752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bf499-6c79-4fd7-9ebc-3556d9eb4aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:54.777097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bf499-6c79-4fd7-9ebc-3556d9eb4aca admin admin] PATH_INFO: `/v3/projects/2d4e15167edb43f396f86e745ff3ab7d/users/24aa0d0222a0496eb903d2a775045de5/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:54.781494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:54.823848 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bf499-6c79-4fd7-9ebc-3556d9eb4aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4e15167edb43f396f86e745ff3ab7d, user_id=24aa0d0222a0496eb903d2a775045de5, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:54.828298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bf499-6c79-4fd7-9ebc-3556d9eb4aca admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:54.880172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 919/1838] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:54 2022] PUT /identity/v3/projects/2d4e15167edb43f396f86e745ff3ab7d/users/24aa0d0222a0496eb903d2a775045de5/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:17:54.885822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df0c7b-9f62-4d62-baa8-ed191788a947 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:54.896601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df0c7b-9f62-4d62-baa8-ed191788a947 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:55.034689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660952bb-64f0-4ea7-a18e-38c7d3e7d475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:55.035774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660952bb-64f0-4ea7-a18e-38c7d3e7d475 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:55.036219 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660952bb-64f0-4ea7-a18e-38c7d3e7d475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:55.036648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660952bb-64f0-4ea7-a18e-38c7d3e7d475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:55.037558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660952bb-64f0-4ea7-a18e-38c7d3e7d475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:55.041003 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660952bb-64f0-4ea7-a18e-38c7d3e7d475 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:55.074853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 920/1839] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:17:55.079721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bf499-6c79-4fd7-9ebc-3556d9eb4aca admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:55.100030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bf499-6c79-4fd7-9ebc-3556d9eb4aca admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:55.109171 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac916a1-628c-4f77-9f0d-b1cd35a4b1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:55.111678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac916a1-628c-4f77-9f0d-b1cd35a4b1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:55.112440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac916a1-628c-4f77-9f0d-b1cd35a4b1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:55.112881 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac916a1-628c-4f77-9f0d-b1cd35a4b1e3 admin admin] PATH_INFO: `/v3/projects/2d4e15167edb43f396f86e745ff3ab7d/users/24aa0d0222a0496eb903d2a775045de5/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:55.118072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac916a1-628c-4f77-9f0d-b1cd35a4b1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4e15167edb43f396f86e745ff3ab7d, user_id=24aa0d0222a0496eb903d2a775045de5, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:55.123752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac916a1-628c-4f77-9f0d-b1cd35a4b1e3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:55.144181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 920/1840] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:55 2022] PUT /identity/v3/projects/2d4e15167edb43f396f86e745ff3ab7d/users/24aa0d0222a0496eb903d2a775045de5/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:55.154190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f512e2-030c-4208-853f-b679b63c413c None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:55.158924 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f512e2-030c-4208-853f-b679b63c413c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:55.159434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f512e2-030c-4208-853f-b679b63c413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:55.196607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:55.214832 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-82f512e2-030c-4208-853f-b679b63c413c None None] MFA Rules not processed for user `24aa0d0222a0496eb903d2a775045de5`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:55.216854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-82f512e2-030c-4208-853f-b679b63c413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:55.407615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 921/1841] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:55.419528 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac916a1-628c-4f77-9f0d-b1cd35a4b1e3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:55.424952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2ac916a1-628c-4f77-9f0d-b1cd35a4b1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:55.583535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac916a1-628c-4f77-9f0d-b1cd35a4b1e3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:55.598320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1d55a-8030-4a4c-883d-75ceb9b6d9d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:55.600645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d55a-8030-4a4c-883d-75ceb9b6d9d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:55.600952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d55a-8030-4a4c-883d-75ceb9b6d9d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:55.601237 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d55a-8030-4a4c-883d-75ceb9b6d9d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:55.620109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1d55a-8030-4a4c-883d-75ceb9b6d9d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:55.622710 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1d55a-8030-4a4c-883d-75ceb9b6d9d8 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:55.652529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 921/1842] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:55.720037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f512e2-030c-4208-853f-b679b63c413c None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:55.722204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-82f512e2-030c-4208-853f-b679b63c413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:55.751459 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f512e2-030c-4208-853f-b679b63c413c None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:55.762481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20824540-d6f7-4ea8-b478-662d95ceafff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:55.763489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20824540-d6f7-4ea8-b478-662d95ceafff service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:55.763953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20824540-d6f7-4ea8-b478-662d95ceafff service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:55.764578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20824540-d6f7-4ea8-b478-662d95ceafff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:55.925209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20824540-d6f7-4ea8-b478-662d95ceafff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:55.926875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20824540-d6f7-4ea8-b478-662d95ceafff service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:55.950447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 922/1843] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:56.255478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58da9a4-876a-49d3-a0c2-1b6c053b4b78 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:56.255478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58da9a4-876a-49d3-a0c2-1b6c053b4b78 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:56.255478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58da9a4-876a-49d3-a0c2-1b6c053b4b78 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:56.255478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 922/1844] 10.222.0.23 () {54 vars in 921 bytes} [Tue Jun 28 03:17:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:17:56.276582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20824540-d6f7-4ea8-b478-662d95ceafff service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:56.278137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-20824540-d6f7-4ea8-b478-662d95ceafff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:56.299795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab9ff3-5fd1-44a4-be16-42364124907c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:56.300389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab9ff3-5fd1-44a4-be16-42364124907c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:56.301027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab9ff3-5fd1-44a4-be16-42364124907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:56.404571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b7ab9ff3-5fd1-44a4-be16-42364124907c None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:56.413819 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b7ab9ff3-5fd1-44a4-be16-42364124907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:56.516073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20824540-d6f7-4ea8-b478-662d95ceafff service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:56.547593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:56.550206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:56.567530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:56.568197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] PATH_INFO: `/v3/projects/8cd4357e046d431d8caae8eb2335efcc` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:56.574916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd4357e046d431d8caae8eb2335efcc)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:56.586975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:56.770902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:56.796870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd4357e046d431d8caae8eb2335efcc', 'request_id': 'req-9fc20e2b-e83b-4650-b824-e625e05460ef'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:56.823508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 923/1845] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Jun 28 03:17:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:56.824641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab9ff3-5fd1-44a4-be16-42364124907c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:56.829766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b7ab9ff3-5fd1-44a4-be16-42364124907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:56.848931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd4357e046d431d8caae8eb2335efcc', 'request_id': 'req-9fc20e2b-e83b-4650-b824-e625e05460ef'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:56.872594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd4357e046d431d8caae8eb2335efcc', 'request_id': 'req-9fc20e2b-e83b-4650-b824-e625e05460ef'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:56.888114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab9ff3-5fd1-44a4-be16-42364124907c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:56.908117 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] The token cache is being invalidate because project 8cd4357e046d431d8caae8eb2335efcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:56.908350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:56.913353 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:56.919843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 923/1846] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:56 2022] DELETE /identity/v3/projects/8cd4357e046d431d8caae8eb2335efcc => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:56.923258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:56.925419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:57.095776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc20e2b-e83b-4650-b824-e625e05460ef admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:57.099537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319512ea-9352-47fb-8d19-905e45f2afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:57.101295 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319512ea-9352-47fb-8d19-905e45f2afb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:57.101689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319512ea-9352-47fb-8d19-905e45f2afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:57.103712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319512ea-9352-47fb-8d19-905e45f2afb1 admin admin] PATH_INFO: `/v3/users/a398269fe6ba498397b68d8ede89db44` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:57.107370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319512ea-9352-47fb-8d19-905e45f2afb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a398269fe6ba498397b68d8ede89db44)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:57.108893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:57.110000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:57.110846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:57.111706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] PATH_INFO: `/v3/users/dfa131a69b0341dfa12d91924b5c0647` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:57.113506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa131a69b0341dfa12d91924b5c0647)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:57.116476 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:57.127403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319512ea-9352-47fb-8d19-905e45f2afb1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:57.154845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:57.282165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-319512ea-9352-47fb-8d19-905e45f2afb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a398269fe6ba498397b68d8ede89db44'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:57.284756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-319512ea-9352-47fb-8d19-905e45f2afb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a398269fe6ba498397b68d8ede89db44'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:57.299757 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-319512ea-9352-47fb-8d19-905e45f2afb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a398269fe6ba498397b68d8ede89db44'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:57.308445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa131a69b0341dfa12d91924b5c0647'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:57.313699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa131a69b0341dfa12d91924b5c0647'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:57.333950 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-319512ea-9352-47fb-8d19-905e45f2afb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a398269fe6ba498397b68d8ede89db44'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:57.340439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa131a69b0341dfa12d91924b5c0647'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:57.344433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-319512ea-9352-47fb-8d19-905e45f2afb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a398269fe6ba498397b68d8ede89db44'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:57.357840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 924/1847] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:56 2022] DELETE /identity/v3/users/a398269fe6ba498397b68d8ede89db44 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:57.362455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6112-372a-472f-97bb-711b1e9ba8ac None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:57.362978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6112-372a-472f-97bb-711b1e9ba8ac None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:57.363363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6112-372a-472f-97bb-711b1e9ba8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:57.368040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa131a69b0341dfa12d91924b5c0647'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:57.383774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa131a69b0341dfa12d91924b5c0647'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:57.389031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2cae6112-372a-472f-97bb-711b1e9ba8ac None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:57.390720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2cae6112-372a-472f-97bb-711b1e9ba8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:57.392308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 924/1848] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:56 2022] DELETE /identity/v3/users/dfa131a69b0341dfa12d91924b5c0647 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:57.493598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 925/1849] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:57.510898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:57.513867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:57.676235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:57.685452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae6112-372a-472f-97bb-711b1e9ba8ac None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:57.690333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2cae6112-372a-472f-97bb-711b1e9ba8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:57.693966 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2c7f5-9072-4800-a8fb-a2de190789ef admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:57.703773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd32a80-0871-48fc-b8b3-26830a9ab029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:57.705078 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd32a80-0871-48fc-b8b3-26830a9ab029 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:57.706891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd32a80-0871-48fc-b8b3-26830a9ab029 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:57.707249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd32a80-0871-48fc-b8b3-26830a9ab029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:57.727552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd32a80-0871-48fc-b8b3-26830a9ab029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:57.729336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd32a80-0871-48fc-b8b3-26830a9ab029 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:57.741696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 925/1850] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:57.983843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae6112-372a-472f-97bb-711b1e9ba8ac None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:57.991037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c396255-9645-4a48-a1be-b05f59166455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:57.991860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396255-9645-4a48-a1be-b05f59166455 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:57.992204 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396255-9645-4a48-a1be-b05f59166455 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:57.992545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396255-9645-4a48-a1be-b05f59166455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:57.995272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1c396255-9645-4a48-a1be-b05f59166455 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:58.014374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c396255-9645-4a48-a1be-b05f59166455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:58.016128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c396255-9645-4a48-a1be-b05f59166455 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:58.028816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 926/1851] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:58.432641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd32a80-0871-48fc-b8b3-26830a9ab029 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:58.434262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6dd32a80-0871-48fc-b8b3-26830a9ab029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:58.448137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd32a80-0871-48fc-b8b3-26830a9ab029 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:58.454843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:58.456333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:58.458149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:58.458920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] PATH_INFO: `/v3/projects/e0dffbe226954d38a4e73c7c9177800a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:58.461232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0dffbe226954d38a4e73c7c9177800a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:58.463875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:58.550176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0dffbe226954d38a4e73c7c9177800a', 'request_id': 'req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:58.559059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0dffbe226954d38a4e73c7c9177800a', 'request_id': 'req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:58.571851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0dffbe226954d38a4e73c7c9177800a', 'request_id': 'req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:58.588477 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] The token cache is being invalidate because project e0dffbe226954d38a4e73c7c9177800a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:58.589092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:58.590099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:58.596106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 926/1852] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:58 2022] DELETE /identity/v3/projects/e0dffbe226954d38a4e73c7c9177800a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:58.597465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42ffc4-a29d-451a-9b6f-42c75ad261ba None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:58.597993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42ffc4-a29d-451a-9b6f-42c75ad261ba None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:58.597993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42ffc4-a29d-451a-9b6f-42c75ad261ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:58.621152 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6e42ffc4-a29d-451a-9b6f-42c75ad261ba None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:58.622717 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6e42ffc4-a29d-451a-9b6f-42c75ad261ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:58.628795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:58.711115 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:58.712580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:58.746505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 927/1853] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:58.754281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939f8ff-8b1c-4c92-897e-5d6ae317b783 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:58.754685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939f8ff-8b1c-4c92-897e-5d6ae317b783 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:58.755027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939f8ff-8b1c-4c92-897e-5d6ae317b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:58.780317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a939f8ff-8b1c-4c92-897e-5d6ae317b783 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:58.781721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a939f8ff-8b1c-4c92-897e-5d6ae317b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:58.793628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 928/1854] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:58.798449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939f8ff-8b1c-4c92-897e-5d6ae317b783 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:58.806383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4c2fe-33e2-47dc-9dba-6513104a9ad3 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:58.810939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939f8ff-8b1c-4c92-897e-5d6ae317b783 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:58.812846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:58.813821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:58.814104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:58.814632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] PATH_INFO: `/v3/projects/e5c2e70ed1ad46bb8e588f5b231335fa` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:58.815861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c2e70ed1ad46bb8e588f5b231335fa)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:58.816033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04f0d0-5dfb-4c0f-84b3-4108892c39f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:58.816814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04f0d0-5dfb-4c0f-84b3-4108892c39f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:58.817181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04f0d0-5dfb-4c0f-84b3-4108892c39f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:58.817519 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04f0d0-5dfb-4c0f-84b3-4108892c39f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:58.817838 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:58.818429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04f0d0-5dfb-4c0f-84b3-4108892c39f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:17:58.818796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04f0d0-5dfb-4c0f-84b3-4108892c39f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:58.820977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04f0d0-5dfb-4c0f-84b3-4108892c39f3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:58.834479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 929/1855] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:17:58.838803 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04f0d0-5dfb-4c0f-84b3-4108892c39f3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:58.851870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04f0d0-5dfb-4c0f-84b3-4108892c39f3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:58.857481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf27e-99f8-41ba-bb8e-9763da456ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:58.858212 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf27e-99f8-41ba-bb8e-9763da456ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:58.858482 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf27e-99f8-41ba-bb8e-9763da456ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:58.858757 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf27e-99f8-41ba-bb8e-9763da456ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:58.859451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf27e-99f8-41ba-bb8e-9763da456ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:58.861614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf27e-99f8-41ba-bb8e-9763da456ff9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:58.871489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c2e70ed1ad46bb8e588f5b231335fa', 'request_id': 'req-fd7018e0-43cc-4e5a-a3e9-123779303641'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:58.888023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c2e70ed1ad46bb8e588f5b231335fa', 'request_id': 'req-fd7018e0-43cc-4e5a-a3e9-123779303641'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:58.894545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 930/1856] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:17:58 2022] POST /identity/v3/projects => generated 359 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:17:58.895813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c2e70ed1ad46bb8e588f5b231335fa', 'request_id': 'req-fd7018e0-43cc-4e5a-a3e9-123779303641'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:58.900219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf27e-99f8-41ba-bb8e-9763da456ff9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:58.906582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] The token cache is being invalidate because project e5c2e70ed1ad46bb8e588f5b231335fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:58.906876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:58.907697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:58.909576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 927/1857] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:58 2022] DELETE /identity/v3/projects/e5c2e70ed1ad46bb8e588f5b231335fa => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:58.913145 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:58.914520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:58.919885 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:58.964093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf27e-99f8-41ba-bb8e-9763da456ff9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:58.969370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd9d85-0cb0-40b2-9074-66a95667d384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:58.970101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd9d85-0cb0-40b2-9074-66a95667d384 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:58.970517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd9d85-0cb0-40b2-9074-66a95667d384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:58.970792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd9d85-0cb0-40b2-9074-66a95667d384 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:58.971499 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd9d85-0cb0-40b2-9074-66a95667d384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:58.973436 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd9d85-0cb0-40b2-9074-66a95667d384 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:58.988179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7018e0-43cc-4e5a-a3e9-123779303641 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:58.993492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcdc8c-2df6-498e-9aa5-3e677839ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:58.994864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcdc8c-2df6-498e-9aa5-3e677839ecea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:58.994979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcdc8c-2df6-498e-9aa5-3e677839ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:58.995274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcdc8c-2df6-498e-9aa5-3e677839ecea admin admin] PATH_INFO: `/v3/users/c4b300ae35d94985b6526275c4dea8b2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:58.996989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcdc8c-2df6-498e-9aa5-3e677839ecea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b300ae35d94985b6526275c4dea8b2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:58.999408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcdc8c-2df6-498e-9aa5-3e677839ecea admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:59.002400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 931/1858] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:17:58 2022] POST /identity/v3/users => generated 280 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:17:59.006444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd9d85-0cb0-40b2-9074-66a95667d384 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:59.008133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-27fd9d85-0cb0-40b2-9074-66a95667d384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:59.020407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd9d85-0cb0-40b2-9074-66a95667d384 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:59.025515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cb112-ab69-443f-ab0e-b5875a4037c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:59.026391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cb112-ab69-443f-ab0e-b5875a4037c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:59.026706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cb112-ab69-443f-ab0e-b5875a4037c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:59.026955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cb112-ab69-443f-ab0e-b5875a4037c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:59.027852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cb112-ab69-443f-ab0e-b5875a4037c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:59.029510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cb112-ab69-443f-ab0e-b5875a4037c7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:59.040703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 932/1859] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:17:59.048227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cb112-ab69-443f-ab0e-b5875a4037c7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:59.055591 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cb112-ab69-443f-ab0e-b5875a4037c7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:59.061374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-3dbcdc8c-2df6-498e-9aa5-3e677839ecea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b300ae35d94985b6526275c4dea8b2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.061573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7443abf-ea22-4e3d-8220-6050c7230bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:59.062068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-3dbcdc8c-2df6-498e-9aa5-3e677839ecea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b300ae35d94985b6526275c4dea8b2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.062350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7443abf-ea22-4e3d-8220-6050c7230bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:59.062602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7443abf-ea22-4e3d-8220-6050c7230bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:59.062880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7443abf-ea22-4e3d-8220-6050c7230bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:59.063838 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7443abf-ea22-4e3d-8220-6050c7230bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:59.065511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7443abf-ea22-4e3d-8220-6050c7230bd9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:59.071481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-3dbcdc8c-2df6-498e-9aa5-3e677839ecea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b300ae35d94985b6526275c4dea8b2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.078852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 933/1860] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:17:59.081040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-3dbcdc8c-2df6-498e-9aa5-3e677839ecea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b300ae35d94985b6526275c4dea8b2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.083078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7443abf-ea22-4e3d-8220-6050c7230bd9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:59.094200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7443abf-ea22-4e3d-8220-6050c7230bd9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:59.095465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-3dbcdc8c-2df6-498e-9aa5-3e677839ecea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b300ae35d94985b6526275c4dea8b2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.099031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff8f58-b42b-4902-b21b-76f5303071ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:59.100304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8f58-b42b-4902-b21b-76f5303071ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:59.100583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8f58-b42b-4902-b21b-76f5303071ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:59.100857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8f58-b42b-4902-b21b-76f5303071ec admin admin] PATH_INFO: `/v3/projects/3fba009b526344889273f758636b093a/users/5d1aeebfb17e407dab09a681e5ba2463/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:59.109884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 928/1861] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:58 2022] DELETE /identity/v3/users/c4b300ae35d94985b6526275c4dea8b2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:17:59.117380 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff8f58-b42b-4902-b21b-76f5303071ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fba009b526344889273f758636b093a, user_id=5d1aeebfb17e407dab09a681e5ba2463, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:59.120222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff8f58-b42b-4902-b21b-76f5303071ec admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:59.136615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 934/1862] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:17:59 2022] PUT /identity/v3/projects/3fba009b526344889273f758636b093a/users/5d1aeebfb17e407dab09a681e5ba2463/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:59.147938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79430-e943-409a-ac39-b820f1b6631a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:59.148645 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79430-e943-409a-ac39-b820f1b6631a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:59.149520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79430-e943-409a-ac39-b820f1b6631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:59.190563 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-03c79430-e943-409a-ac39-b820f1b6631a None None] MFA Rules not processed for user `5d1aeebfb17e407dab09a681e5ba2463`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:59.191949 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-03c79430-e943-409a-ac39-b820f1b6631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:59.312656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 929/1863] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:59 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:59.346865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff8f58-b42b-4902-b21b-76f5303071ec admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:59.350875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-84ff8f58-b42b-4902-b21b-76f5303071ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:59.367245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:59.433209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff8f58-b42b-4902-b21b-76f5303071ec admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:59.434641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c79430-e943-409a-ac39-b820f1b6631a None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:59.435810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f58b97-09d8-4abb-8919-1ee037b7a4af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:59.436160 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-03c79430-e943-409a-ac39-b820f1b6631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:59.436629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f58b97-09d8-4abb-8919-1ee037b7a4af service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:59.436982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f58b97-09d8-4abb-8919-1ee037b7a4af service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:59.437360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f58b97-09d8-4abb-8919-1ee037b7a4af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:59.449423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f58b97-09d8-4abb-8919-1ee037b7a4af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:59.451440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f58b97-09d8-4abb-8919-1ee037b7a4af service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:59.452152 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:59.464017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 935/1864] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:17:59 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:17:59.481791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f58b97-09d8-4abb-8919-1ee037b7a4af service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:59.484324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e3f58b97-09d8-4abb-8919-1ee037b7a4af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:59.529651 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c79430-e943-409a-ac39-b820f1b6631a None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:59.538396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:59.540618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:59.541388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:59.542281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] PATH_INFO: `/v3/projects/aa32f451168346038f350811eeadf8d3` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:59.544167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa32f451168346038f350811eeadf8d3)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:59.547445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:59.604818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f58b97-09d8-4abb-8919-1ee037b7a4af service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:17:59.610670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd05ec-6e18-4caa-b2bf-03097119fa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:17:59.611612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd05ec-6e18-4caa-b2bf-03097119fa79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:59.612024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd05ec-6e18-4caa-b2bf-03097119fa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:59.612304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd05ec-6e18-4caa-b2bf-03097119fa79 admin admin] PATH_INFO: `/v3/users/5d1aeebfb17e407dab09a681e5ba2463` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:59.613811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd05ec-6e18-4caa-b2bf-03097119fa79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1aeebfb17e407dab09a681e5ba2463)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:17:59.615872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd05ec-6e18-4caa-b2bf-03097119fa79 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:17:59.660614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa32f451168346038f350811eeadf8d3', 'request_id': 'req-8a194881-e228-4bca-972d-ba6a16724c13'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.669584 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa32f451168346038f350811eeadf8d3', 'request_id': 'req-8a194881-e228-4bca-972d-ba6a16724c13'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.684531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa32f451168346038f350811eeadf8d3', 'request_id': 'req-8a194881-e228-4bca-972d-ba6a16724c13'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.696706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b4cd05ec-6e18-4caa-b2bf-03097119fa79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1aeebfb17e407dab09a681e5ba2463'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.697440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b4cd05ec-6e18-4caa-b2bf-03097119fa79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1aeebfb17e407dab09a681e5ba2463'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.713050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] The token cache is being invalidate because project aa32f451168346038f350811eeadf8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:17:59.713351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.714871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-8a194881-e228-4bca-972d-ba6a16724c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.717227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 930/1865] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:17:59 2022] DELETE /identity/v3/projects/aa32f451168346038f350811eeadf8d3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:17:59.723448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dca195-c3f4-4079-add9-e804dfea6877 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:59.723746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dca195-c3f4-4079-add9-e804dfea6877 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:59.724130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dca195-c3f4-4079-add9-e804dfea6877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:59.733507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b4cd05ec-6e18-4caa-b2bf-03097119fa79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1aeebfb17e407dab09a681e5ba2463'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.754049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-c4dca195-c3f4-4079-add9-e804dfea6877 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:59.755687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c4dca195-c3f4-4079-add9-e804dfea6877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:59.768260 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b4cd05ec-6e18-4caa-b2bf-03097119fa79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1aeebfb17e407dab09a681e5ba2463'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.781971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b4cd05ec-6e18-4caa-b2bf-03097119fa79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1aeebfb17e407dab09a681e5ba2463'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:17:59.795590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 936/1866] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:17:59 2022] DELETE /identity/v3/users/5d1aeebfb17e407dab09a681e5ba2463 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:17:59.800896 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0cd9-015c-44e2-9e94-dc716cd97fc0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:59.801304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0cd9-015c-44e2-9e94-dc716cd97fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:59.802445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0cd9-015c-44e2-9e94-dc716cd97fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:59.841366 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7ced0cd9-015c-44e2-9e94-dc716cd97fc0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:59.842797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7ced0cd9-015c-44e2-9e94-dc716cd97fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:59.902470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 931/1867] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:59.911985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c7c1-3201-4f03-9855-e4552405fda9 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:17:59.912636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c7c1-3201-4f03-9855-e4552405fda9 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:17:59.913724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c7c1-3201-4f03-9855-e4552405fda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:17:59.919738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:59.960394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-cff6c7c1-3201-4f03-9855-e4552405fda9 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:17:59.961973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cff6c7c1-3201-4f03-9855-e4552405fda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:17:59.982088 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 932/1868] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:17:59.986403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6c7c1-3201-4f03-9855-e4552405fda9 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:17:59.997922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 937/1869] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:17:59.998129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6c7c1-3201-4f03-9855-e4552405fda9 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:00.006545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced0cd9-015c-44e2-9e94-dc716cd97fc0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:00.007388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281f48e-f1e5-4c0f-8af1-471d76df0375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:00.008092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281f48e-f1e5-4c0f-8af1-471d76df0375 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:00.008370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281f48e-f1e5-4c0f-8af1-471d76df0375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:00.008640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281f48e-f1e5-4c0f-8af1-471d76df0375 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:00.009273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7ced0cd9-015c-44e2-9e94-dc716cd97fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:00.009407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281f48e-f1e5-4c0f-8af1-471d76df0375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:00.009673 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281f48e-f1e5-4c0f-8af1-471d76df0375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:00.011747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281f48e-f1e5-4c0f-8af1-471d76df0375 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:00.026827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 933/1870] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:18:00.031282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281f48e-f1e5-4c0f-8af1-471d76df0375 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:00.044170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281f48e-f1e5-4c0f-8af1-471d76df0375 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:00.065353 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820d4d-9036-4868-b7f6-d1d71750d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:00.066137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820d4d-9036-4868-b7f6-d1d71750d129 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:00.066355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820d4d-9036-4868-b7f6-d1d71750d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:00.066626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820d4d-9036-4868-b7f6-d1d71750d129 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:00.068063 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06820d4d-9036-4868-b7f6-d1d71750d129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:00.070734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06820d4d-9036-4868-b7f6-d1d71750d129 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:00.090728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced0cd9-015c-44e2-9e94-dc716cd97fc0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:00.096059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeab41c-7aab-4aae-8286-04191d72911b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:00.096982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeab41c-7aab-4aae-8286-04191d72911b service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:00.097279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeab41c-7aab-4aae-8286-04191d72911b service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:00.097636 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeab41c-7aab-4aae-8286-04191d72911b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:00.102168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:00.109242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeab41c-7aab-4aae-8286-04191d72911b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:00.111794 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeab41c-7aab-4aae-8286-04191d72911b service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:00.114255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 934/1871] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:00 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:00.129351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 938/1872] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:00.129757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820d4d-9036-4868-b7f6-d1d71750d129 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:00.252536 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820d4d-9036-4868-b7f6-d1d71750d129 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:00.268067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45e31-ec28-48e4-a24a-ea9d5fde7586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:00.269021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45e31-ec28-48e4-a24a-ea9d5fde7586 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:00.269358 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45e31-ec28-48e4-a24a-ea9d5fde7586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:00.269607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45e31-ec28-48e4-a24a-ea9d5fde7586 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:00.270683 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd45e31-ec28-48e4-a24a-ea9d5fde7586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:00.273380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd45e31-ec28-48e4-a24a-ea9d5fde7586 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:00.348526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 935/1873] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:00 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:00.352688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeab41c-7aab-4aae-8286-04191d72911b service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:00.371652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeab41c-7aab-4aae-8286-04191d72911b service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:00.391222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f02e4-f21f-4859-8e10-41f9a7e7860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:00.394070 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f02e4-f21f-4859-8e10-41f9a7e7860e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:00.394497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f02e4-f21f-4859-8e10-41f9a7e7860e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:00.394775 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f02e4-f21f-4859-8e10-41f9a7e7860e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:00.395810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f02e4-f21f-4859-8e10-41f9a7e7860e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:00.403732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f02e4-f21f-4859-8e10-41f9a7e7860e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:00.445779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 939/1874] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:00.449870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45e31-ec28-48e4-a24a-ea9d5fde7586 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:00.470350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45e31-ec28-48e4-a24a-ea9d5fde7586 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:00.484897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e32e9-e3c7-4c1c-aa5d-9e706741f31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:00.487274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e32e9-e3c7-4c1c-aa5d-9e706741f31c admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:00.488608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e32e9-e3c7-4c1c-aa5d-9e706741f31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:00.489076 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e32e9-e3c7-4c1c-aa5d-9e706741f31c admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:00.490606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e32e9-e3c7-4c1c-aa5d-9e706741f31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:00.496050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e32e9-e3c7-4c1c-aa5d-9e706741f31c admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:00.516430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f02e4-f21f-4859-8e10-41f9a7e7860e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:00.517824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 936/1875] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:00.530410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f02e4-f21f-4859-8e10-41f9a7e7860e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:00.539107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d45bcb-5485-4142-b486-9c2bc345fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:00.540154 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d45bcb-5485-4142-b486-9c2bc345fc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:00.540997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d45bcb-5485-4142-b486-9c2bc345fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:00.541388 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d45bcb-5485-4142-b486-9c2bc345fc1d admin admin] PATH_INFO: `/v3/projects/a04659a2b12b48c3baa2fd626f9e8b98/users/dd44529f7fbd454e8d5831fa8d7fdb67/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:00.573097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d45bcb-5485-4142-b486-9c2bc345fc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04659a2b12b48c3baa2fd626f9e8b98, user_id=dd44529f7fbd454e8d5831fa8d7fdb67, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:00.576641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d45bcb-5485-4142-b486-9c2bc345fc1d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:00.610197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 940/1876] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:00 2022] PUT /identity/v3/projects/a04659a2b12b48c3baa2fd626f9e8b98/users/dd44529f7fbd454e8d5831fa8d7fdb67/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:00.612083 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e966e-1f09-4c56-a838-3ca1fe775763 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:00.612618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e966e-1f09-4c56-a838-3ca1fe775763 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:00.612949 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e966e-1f09-4c56-a838-3ca1fe775763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:00.648280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6f6e966e-1f09-4c56-a838-3ca1fe775763 None None] MFA Rules not processed for user `dd44529f7fbd454e8d5831fa8d7fdb67`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:00.649546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6f6e966e-1f09-4c56-a838-3ca1fe775763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:00.749439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 937/1877] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:00.754254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d45bcb-5485-4142-b486-9c2bc345fc1d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:00.763967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e966e-1f09-4c56-a838-3ca1fe775763 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:00.766504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6f6e966e-1f09-4c56-a838-3ca1fe775763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:00.856782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e966e-1f09-4c56-a838-3ca1fe775763 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:00.863463 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:00.867169 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:00.867761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:00.868346 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] PATH_INFO: `/v3/projects/3fba009b526344889273f758636b093a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:00.869984 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fba009b526344889273f758636b093a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:00.871612 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:00.882883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:00.887522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d45bcb-5485-4142-b486-9c2bc345fc1d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:00.894040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481df9e3-d66a-4ad4-9636-3e5631feefe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:00.894753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481df9e3-d66a-4ad4-9636-3e5631feefe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:00.895034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481df9e3-d66a-4ad4-9636-3e5631feefe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:00.895334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481df9e3-d66a-4ad4-9636-3e5631feefe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:00.896042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481df9e3-d66a-4ad4-9636-3e5631feefe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:00.897981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481df9e3-d66a-4ad4-9636-3e5631feefe7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:00.921721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fba009b526344889273f758636b093a', 'request_id': 'req-18bb8fe3-87b3-4966-b1a9-65a287411f2f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:00.928451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 941/1878] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:00 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:00.928615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fba009b526344889273f758636b093a', 'request_id': 'req-18bb8fe3-87b3-4966-b1a9-65a287411f2f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:00.929502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481df9e3-d66a-4ad4-9636-3e5631feefe7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:00.936571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fba009b526344889273f758636b093a', 'request_id': 'req-18bb8fe3-87b3-4966-b1a9-65a287411f2f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:00.947025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] The token cache is being invalidate because project 3fba009b526344889273f758636b093a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:00.947327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:00.947943 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-18bb8fe3-87b3-4966-b1a9-65a287411f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:00.949729 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 938/1879] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:00 2022] DELETE /identity/v3/projects/3fba009b526344889273f758636b093a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:00.954264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd928fe-e693-416b-a16a-02ada08eb150 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:00.954578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd928fe-e693-416b-a16a-02ada08eb150 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:00.955023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd928fe-e693-416b-a16a-02ada08eb150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:00.961156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:00.974157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-cfd928fe-e693-416b-a16a-02ada08eb150 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:00.975772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cfd928fe-e693-416b-a16a-02ada08eb150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:00.998017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481df9e3-d66a-4ad4-9636-3e5631feefe7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.003484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e2d7-8ab1-45d6-9880-db9aed88a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.004200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e2d7-8ab1-45d6-9880-db9aed88a815 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.004484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e2d7-8ab1-45d6-9880-db9aed88a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.004762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e2d7-8ab1-45d6-9880-db9aed88a815 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.005453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54e2d7-8ab1-45d6-9880-db9aed88a815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.007440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54e2d7-8ab1-45d6-9880-db9aed88a815 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.028576 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 942/1880] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:00 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:01.032568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e2d7-8ab1-45d6-9880-db9aed88a815 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.034516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4d54e2d7-8ab1-45d6-9880-db9aed88a815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:01.039832 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 939/1881] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:01.047472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878f82c-adca-415e-b0f8-48b352cb6f65 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.047679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878f82c-adca-415e-b0f8-48b352cb6f65 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.048047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878f82c-adca-415e-b0f8-48b352cb6f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.050066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e2d7-8ab1-45d6-9880-db9aed88a815 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.055936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d42e0f-6b50-49ea-a947-54f626eb8111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.056659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d42e0f-6b50-49ea-a947-54f626eb8111 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.056941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d42e0f-6b50-49ea-a947-54f626eb8111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.062404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d42e0f-6b50-49ea-a947-54f626eb8111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.062404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d42e0f-6b50-49ea-a947-54f626eb8111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.062404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d42e0f-6b50-49ea-a947-54f626eb8111 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.069154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6878f82c-adca-415e-b0f8-48b352cb6f65 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:01.070469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6878f82c-adca-415e-b0f8-48b352cb6f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:01.071399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 943/1882] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:01.075590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d42e0f-6b50-49ea-a947-54f626eb8111 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.082097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 940/1883] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:01.085908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878f82c-adca-415e-b0f8-48b352cb6f65 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.086250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d42e0f-6b50-49ea-a947-54f626eb8111 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.091231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510e8d6-8d19-4b0f-bc73-3f9528e3acec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.092143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510e8d6-8d19-4b0f-bc73-3f9528e3acec admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.092421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510e8d6-8d19-4b0f-bc73-3f9528e3acec admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.092691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510e8d6-8d19-4b0f-bc73-3f9528e3acec admin admin] PATH_INFO: `/v3/projects/8b236b09dc1144d79941534b7386b01f/users/e21d38d818d145ff9f17df2d2393c44f/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.095070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878f82c-adca-415e-b0f8-48b352cb6f65 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.100249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31aeb7-53b2-4218-9623-a60a660065c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.100953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31aeb7-53b2-4218-9623-a60a660065c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.101878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31aeb7-53b2-4218-9623-a60a660065c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.102180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31aeb7-53b2-4218-9623-a60a660065c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.103030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31aeb7-53b2-4218-9623-a60a660065c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:01.103335 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31aeb7-53b2-4218-9623-a60a660065c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.105235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31aeb7-53b2-4218-9623-a60a660065c9 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.110747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510e8d6-8d19-4b0f-bc73-3f9528e3acec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b236b09dc1144d79941534b7386b01f, user_id=e21d38d818d145ff9f17df2d2393c44f, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.113534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510e8d6-8d19-4b0f-bc73-3f9528e3acec admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.118161 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 941/1884] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:18:01.123102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31aeb7-53b2-4218-9623-a60a660065c9 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.129792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 944/1885] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:01 2022] PUT /identity/v3/projects/8b236b09dc1144d79941534b7386b01f/users/e21d38d818d145ff9f17df2d2393c44f/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:01.133339 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510e8d6-8d19-4b0f-bc73-3f9528e3acec admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.134118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31aeb7-53b2-4218-9623-a60a660065c9 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.211575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510e8d6-8d19-4b0f-bc73-3f9528e3acec admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.217336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d600-ee8d-4e55-b3e8-e56c3c2fb0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.218211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d600-ee8d-4e55-b3e8-e56c3c2fb0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.218573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d600-ee8d-4e55-b3e8-e56c3c2fb0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.219449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d600-ee8d-4e55-b3e8-e56c3c2fb0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.220194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71d600-ee8d-4e55-b3e8-e56c3c2fb0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.222167 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71d600-ee8d-4e55-b3e8-e56c3c2fb0b8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.236091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 945/1886] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:01.239352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d600-ee8d-4e55-b3e8-e56c3c2fb0b8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.253608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d600-ee8d-4e55-b3e8-e56c3c2fb0b8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.260704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32866-fecb-428f-b5b1-3c2594084760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.262439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32866-fecb-428f-b5b1-3c2594084760 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.262829 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32866-fecb-428f-b5b1-3c2594084760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.263090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32866-fecb-428f-b5b1-3c2594084760 admin admin] PATH_INFO: `/v3/projects/8b236b09dc1144d79941534b7386b01f/users/e21d38d818d145ff9f17df2d2393c44f/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.265760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32866-fecb-428f-b5b1-3c2594084760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b236b09dc1144d79941534b7386b01f, user_id=e21d38d818d145ff9f17df2d2393c44f, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.269451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32866-fecb-428f-b5b1-3c2594084760 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.275040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08a94-e6d1-4dd9-b271-332baf299246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.275530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08a94-e6d1-4dd9-b271-332baf299246 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.275954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08a94-e6d1-4dd9-b271-332baf299246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.276232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08a94-e6d1-4dd9-b271-332baf299246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.276941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e08a94-e6d1-4dd9-b271-332baf299246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.283152 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 946/1887] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:01 2022] PUT /identity/v3/projects/8b236b09dc1144d79941534b7386b01f/users/e21d38d818d145ff9f17df2d2393c44f/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:01.293748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e08a94-e6d1-4dd9-b271-332baf299246 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.294456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211195b5-392f-409b-b88d-486b0ce5a498 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.295549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211195b5-392f-409b-b88d-486b0ce5a498 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.295907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211195b5-392f-409b-b88d-486b0ce5a498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.348691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 942/1888] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:01 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:01.350746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08a94-e6d1-4dd9-b271-332baf299246 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.356731 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-211195b5-392f-409b-b88d-486b0ce5a498 None None] MFA Rules not processed for user `e21d38d818d145ff9f17df2d2393c44f`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:01.357858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:01.358357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-211195b5-392f-409b-b88d-486b0ce5a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:01.450579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:01.455427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08a94-e6d1-4dd9-b271-332baf299246 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.465358 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a4561-3d9c-46ce-b648-4bf2a70b186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.467088 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a4561-3d9c-46ce-b648-4bf2a70b186b admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.467379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a4561-3d9c-46ce-b648-4bf2a70b186b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.467655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a4561-3d9c-46ce-b648-4bf2a70b186b admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.468366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a4561-3d9c-46ce-b648-4bf2a70b186b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.471070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a4561-3d9c-46ce-b648-4bf2a70b186b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.492363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 947/1889] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:01.507878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211195b5-392f-409b-b88d-486b0ce5a498 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.511051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-211195b5-392f-409b-b88d-486b0ce5a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:01.513093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 943/1890] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:01 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:01.517470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a4561-3d9c-46ce-b648-4bf2a70b186b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.532078 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a4561-3d9c-46ce-b648-4bf2a70b186b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.539242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9b691-fbdb-4e58-8aad-ea0deef349c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.540595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9b691-fbdb-4e58-8aad-ea0deef349c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.541632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9b691-fbdb-4e58-8aad-ea0deef349c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.541988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9b691-fbdb-4e58-8aad-ea0deef349c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.542949 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9b691-fbdb-4e58-8aad-ea0deef349c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.545095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9b691-fbdb-4e58-8aad-ea0deef349c1 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.562389 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 944/1891] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:01.567752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9b691-fbdb-4e58-8aad-ea0deef349c1 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.584678 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9b691-fbdb-4e58-8aad-ea0deef349c1 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.593969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c5079-0077-4fa3-bdb5-71b9c8b98def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.596086 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5079-0077-4fa3-bdb5-71b9c8b98def admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.596086 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5079-0077-4fa3-bdb5-71b9c8b98def admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.597131 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5079-0077-4fa3-bdb5-71b9c8b98def admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.598150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c5079-0077-4fa3-bdb5-71b9c8b98def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.601496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c5079-0077-4fa3-bdb5-71b9c8b98def admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.617455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 945/1892] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:01.622007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c5079-0077-4fa3-bdb5-71b9c8b98def admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.622517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211195b5-392f-409b-b88d-486b0ce5a498 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.631053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a2501-2b2f-4394-8e63-4294e7d60665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.634456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a2501-2b2f-4394-8e63-4294e7d60665 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.634804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a2501-2b2f-4394-8e63-4294e7d60665 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.635134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a2501-2b2f-4394-8e63-4294e7d60665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.637255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c5079-0077-4fa3-bdb5-71b9c8b98def admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.637508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d33a2501-2b2f-4394-8e63-4294e7d60665 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:01.645082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a647-e5b8-41f2-90f4-36592001cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.648312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a647-e5b8-41f2-90f4-36592001cf64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.648764 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a647-e5b8-41f2-90f4-36592001cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.649444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a647-e5b8-41f2-90f4-36592001cf64 admin admin] PATH_INFO: `/v3/projects/564cc9d1349a424abf79c9743487ebfd/users/e2564d53ce1f4b16b5a3cb8a2de32858/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.696102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5a647-e5b8-41f2-90f4-36592001cf64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=564cc9d1349a424abf79c9743487ebfd, user_id=e2564d53ce1f4b16b5a3cb8a2de32858, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.698908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5a647-e5b8-41f2-90f4-36592001cf64 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.740068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a2501-2b2f-4394-8e63-4294e7d60665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.741828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a2501-2b2f-4394-8e63-4294e7d60665 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.744939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 946/1893] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:01 2022] PUT /identity/v3/projects/564cc9d1349a424abf79c9743487ebfd/users/e2564d53ce1f4b16b5a3cb8a2de32858/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:01.755627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 948/1894] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:01.756744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a647-e5b8-41f2-90f4-36592001cf64 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:01.759009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8df5a647-e5b8-41f2-90f4-36592001cf64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:01.770482 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d02b46-21e2-4db1-92ef-d7fd285939e3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.771843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d02b46-21e2-4db1-92ef-d7fd285939e3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.773348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d02b46-21e2-4db1-92ef-d7fd285939e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.850441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-17d02b46-21e2-4db1-92ef-d7fd285939e3 None None] MFA Rules not processed for user `e2564d53ce1f4b16b5a3cb8a2de32858`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:01.851657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-17d02b46-21e2-4db1-92ef-d7fd285939e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:01.902968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a647-e5b8-41f2-90f4-36592001cf64 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:01.915508 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9cce5-dd90-480a-beb4-9556f12844ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:01.917604 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9cce5-dd90-480a-beb4-9556f12844ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:01.917604 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9cce5-dd90-480a-beb4-9556f12844ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:01.917900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9cce5-dd90-480a-beb4-9556f12844ae admin admin] PATH_INFO: `/v3/users/203a7848e4174d56a6f9ac0972ca4c1a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:01.930800 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9cce5-dd90-480a-beb4-9556f12844ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=203a7848e4174d56a6f9ac0972ca4c1a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:01.944095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9cce5-dd90-480a-beb4-9556f12844ae admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:01.982463 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 949/1895] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:02.040374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d02b46-21e2-4db1-92ef-d7fd285939e3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:02.042877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-17d02b46-21e2-4db1-92ef-d7fd285939e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:02.061955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-adb9cce5-dd90-480a-beb4-9556f12844ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '203a7848e4174d56a6f9ac0972ca4c1a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:02.063040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-adb9cce5-dd90-480a-beb4-9556f12844ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '203a7848e4174d56a6f9ac0972ca4c1a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:02.069244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:02.081715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-adb9cce5-dd90-480a-beb4-9556f12844ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '203a7848e4174d56a6f9ac0972ca4c1a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:02.095295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-adb9cce5-dd90-480a-beb4-9556f12844ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '203a7848e4174d56a6f9ac0972ca4c1a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:02.110667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:02.119452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-adb9cce5-dd90-480a-beb4-9556f12844ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '203a7848e4174d56a6f9ac0972ca4c1a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:02.126918 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 947/1896] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:01 2022] DELETE /identity/v3/users/203a7848e4174d56a6f9ac0972ca4c1a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:02.131051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f80066-aa66-489f-b3cf-9f822b36689c None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:02.131409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f80066-aa66-489f-b3cf-9f822b36689c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:02.131858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f80066-aa66-489f-b3cf-9f822b36689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:02.139247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d02b46-21e2-4db1-92ef-d7fd285939e3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:02.152877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f9f80066-aa66-489f-b3cf-9f822b36689c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:02.154181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f9f80066-aa66-489f-b3cf-9f822b36689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:02.216701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f96d7-f026-4729-bb06-feb63e067693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:02.217444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f96d7-f026-4729-bb06-feb63e067693 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:02.217765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f96d7-f026-4729-bb06-feb63e067693 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:02.218044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f96d7-f026-4729-bb06-feb63e067693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:02.221227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a73f96d7-f026-4729-bb06-feb63e067693 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:02.280941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 948/1897] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:02.291144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f80066-aa66-489f-b3cf-9f822b36689c None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:02.292955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f9f80066-aa66-489f-b3cf-9f822b36689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:02.300971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f96d7-f026-4729-bb06-feb63e067693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:02.302517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f96d7-f026-4729-bb06-feb63e067693 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:02.312411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 950/1898] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:18:02.422587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f80066-aa66-489f-b3cf-9f822b36689c None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:02.426963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d90d-71de-4526-8eb2-1f4048150fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:02.427156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d90d-71de-4526-8eb2-1f4048150fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:02.427525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d90d-71de-4526-8eb2-1f4048150fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:02.427731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d90d-71de-4526-8eb2-1f4048150fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:02.442531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d90d-71de-4526-8eb2-1f4048150fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:02.449147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d90d-71de-4526-8eb2-1f4048150fd9 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:02.462680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 949/1899] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:18:02.987890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f96d7-f026-4729-bb06-feb63e067693 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:02.990143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a73f96d7-f026-4729-bb06-feb63e067693 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:03.018922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f96d7-f026-4729-bb06-feb63e067693 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:03.024863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:03.025924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:03.026336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:03.026728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] PATH_INFO: `/v3/projects/c7ffc360d5ea4eebb0cc27c48060d24d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:03.028087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ffc360d5ea4eebb0cc27c48060d24d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:03.030211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:03.253326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ffc360d5ea4eebb0cc27c48060d24d', 'request_id': 'req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:03.265595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ffc360d5ea4eebb0cc27c48060d24d', 'request_id': 'req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:03.279293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ffc360d5ea4eebb0cc27c48060d24d', 'request_id': 'req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:03.301974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bfcdd-4636-4cf2-90d3-0fa1a7dd8836 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:03.302273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bfcdd-4636-4cf2-90d3-0fa1a7dd8836 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:03.302623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bfcdd-4636-4cf2-90d3-0fa1a7dd8836 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:03.304239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 950/1900] 10.222.0.23 () {54 vars in 921 bytes} [Tue Jun 28 03:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:18:03.311065 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] The token cache is being invalidate because project c7ffc360d5ea4eebb0cc27c48060d24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:03.311442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:03.312571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-58250dfc-d287-4c1b-8d4d-c3fb5bb5f444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:03.315214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 951/1901] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:02 2022] DELETE /identity/v3/projects/c7ffc360d5ea4eebb0cc27c48060d24d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:03.319352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bfcdd-4636-4cf2-90d3-0fa1a7dd8836 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:03.321267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-0d5bfcdd-4636-4cf2-90d3-0fa1a7dd8836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:03.331703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac66e3-1548-49ec-8200-789eb97b0089 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:03.332054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac66e3-1548-49ec-8200-789eb97b0089 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:03.333043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac66e3-1548-49ec-8200-789eb97b0089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:03.360427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-15ac66e3-1548-49ec-8200-789eb97b0089 None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:03.363622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-15ac66e3-1548-49ec-8200-789eb97b0089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:03.430732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:03.475684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bfcdd-4636-4cf2-90d3-0fa1a7dd8836 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:03.482137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:03.483437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:03.484009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:03.484432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] PATH_INFO: `/v3/users/24aa0d0222a0496eb903d2a775045de5` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:03.486258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=24aa0d0222a0496eb903d2a775045de5)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:03.489184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:03.523584 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:03.547818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 952/1902] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Jun 28 03:18:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:03.558103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac66e3-1548-49ec-8200-789eb97b0089 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:03.561264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-15ac66e3-1548-49ec-8200-789eb97b0089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:03.589874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24aa0d0222a0496eb903d2a775045de5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:03.591430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24aa0d0222a0496eb903d2a775045de5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:03.603572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24aa0d0222a0496eb903d2a775045de5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:03.622133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24aa0d0222a0496eb903d2a775045de5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:03.649101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24aa0d0222a0496eb903d2a775045de5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:03.672826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 951/1903] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:03 2022] DELETE /identity/v3/users/24aa0d0222a0496eb903d2a775045de5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:03.709713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac66e3-1548-49ec-8200-789eb97b0089 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:03.783446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855b25c-e298-49c4-a897-dadbe6d9b11d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:03.784177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855b25c-e298-49c4-a897-dadbe6d9b11d service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:03.784509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855b25c-e298-49c4-a897-dadbe6d9b11d service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:03.784783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855b25c-e298-49c4-a897-dadbe6d9b11d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:03.790691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f855b25c-e298-49c4-a897-dadbe6d9b11d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:03.806339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:03.807922 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:03.939587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855b25c-e298-49c4-a897-dadbe6d9b11d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:03.944910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855b25c-e298-49c4-a897-dadbe6d9b11d service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:03.983611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 953/1904] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:03.999383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58786d-0ab4-4915-88e8-11ac9e9ac9cd admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:04.005534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c835670-2ed0-47c7-bdc0-30d245aa7376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:04.006205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c835670-2ed0-47c7-bdc0-30d245aa7376 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:04.006522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c835670-2ed0-47c7-bdc0-30d245aa7376 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:04.006794 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c835670-2ed0-47c7-bdc0-30d245aa7376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:04.008567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1c835670-2ed0-47c7-bdc0-30d245aa7376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:04.026635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c835670-2ed0-47c7-bdc0-30d245aa7376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:04.026635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c835670-2ed0-47c7-bdc0-30d245aa7376 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:04.036411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 952/1905] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:18:05.344353 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855b25c-e298-49c4-a897-dadbe6d9b11d service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:05.346544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f855b25c-e298-49c4-a897-dadbe6d9b11d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:05.379687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:05.457318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855b25c-e298-49c4-a897-dadbe6d9b11d service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:05.471898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:05.472829 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:05.473104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:05.473372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] PATH_INFO: `/v3/projects/2d4e15167edb43f396f86e745ff3ab7d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:05.474960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4e15167edb43f396f86e745ff3ab7d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:05.476994 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:05.571520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4e15167edb43f396f86e745ff3ab7d', 'request_id': 'req-95d81c04-058e-4b8d-87be-482850ba31b6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:05.580435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4e15167edb43f396f86e745ff3ab7d', 'request_id': 'req-95d81c04-058e-4b8d-87be-482850ba31b6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:05.590444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4e15167edb43f396f86e745ff3ab7d', 'request_id': 'req-95d81c04-058e-4b8d-87be-482850ba31b6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:05.611392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] The token cache is being invalidate because project 2d4e15167edb43f396f86e745ff3ab7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:05.611794 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:05.612573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-95d81c04-058e-4b8d-87be-482850ba31b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:05.614633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 954/1906] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:05 2022] DELETE /identity/v3/projects/2d4e15167edb43f396f86e745ff3ab7d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:05.619333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0443cda-1e9c-4993-84e4-7564cc8ee4bb None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:05.619835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0443cda-1e9c-4993-84e4-7564cc8ee4bb None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:05.619926 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0443cda-1e9c-4993-84e4-7564cc8ee4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:05.639652 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f0443cda-1e9c-4993-84e4-7564cc8ee4bb None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:05.640862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f0443cda-1e9c-4993-84e4-7564cc8ee4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:05.723751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 953/1907] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:05.731888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ab705-ec44-46f3-8818-d33b16857352 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:05.732182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ab705-ec44-46f3-8818-d33b16857352 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:05.732460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ab705-ec44-46f3-8818-d33b16857352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:05.751305 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c91ab705-ec44-46f3-8818-d33b16857352 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:05.752480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c91ab705-ec44-46f3-8818-d33b16857352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:05.760732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 955/1908] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:05.765786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0443cda-1e9c-4993-84e4-7564cc8ee4bb None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:05.779917 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0443cda-1e9c-4993-84e4-7564cc8ee4bb None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:05.787000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb121-f160-476b-aff2-9d1e5cceb052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:05.788042 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb121-f160-476b-aff2-9d1e5cceb052 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:05.788394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb121-f160-476b-aff2-9d1e5cceb052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:05.789038 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb121-f160-476b-aff2-9d1e5cceb052 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:05.789817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb121-f160-476b-aff2-9d1e5cceb052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:05.798976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb121-f160-476b-aff2-9d1e5cceb052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:05.801570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb121-f160-476b-aff2-9d1e5cceb052 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:05.822659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 954/1909] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:18:05.823959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ab705-ec44-46f3-8818-d33b16857352 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:05.848898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ab705-ec44-46f3-8818-d33b16857352 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:05.863208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609e8bf-3c57-4c67-b91c-8e518d64d557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:05.863982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609e8bf-3c57-4c67-b91c-8e518d64d557 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:05.864161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609e8bf-3c57-4c67-b91c-8e518d64d557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:05.864645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609e8bf-3c57-4c67-b91c-8e518d64d557 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:05.865404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609e8bf-3c57-4c67-b91c-8e518d64d557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:05.871483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609e8bf-3c57-4c67-b91c-8e518d64d557 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:05.924481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 956/1910] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:05 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:05.926002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb121-f160-476b-aff2-9d1e5cceb052 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:05.933595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:05.946884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb121-f160-476b-aff2-9d1e5cceb052 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.037245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb37af6-ed7e-4528-936e-acff56c38583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.038010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb37af6-ed7e-4528-936e-acff56c38583 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.038403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb37af6-ed7e-4528-936e-acff56c38583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.038975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb37af6-ed7e-4528-936e-acff56c38583 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.040347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb37af6-ed7e-4528-936e-acff56c38583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.042887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb37af6-ed7e-4528-936e-acff56c38583 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.080796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 955/1911] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:05 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:06.084935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609e8bf-3c57-4c67-b91c-8e518d64d557 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:06.096284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609e8bf-3c57-4c67-b91c-8e518d64d557 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.101489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f9a4b-5ef1-451d-84c2-a5d99f12030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.102188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f9a4b-5ef1-451d-84c2-a5d99f12030f admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.102727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f9a4b-5ef1-451d-84c2-a5d99f12030f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.103009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f9a4b-5ef1-451d-84c2-a5d99f12030f admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.103745 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f9a4b-5ef1-451d-84c2-a5d99f12030f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.105695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f9a4b-5ef1-451d-84c2-a5d99f12030f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.117304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 957/1912] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:06.121897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb37af6-ed7e-4528-936e-acff56c38583 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:06.132676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb37af6-ed7e-4528-936e-acff56c38583 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.137896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923dd14-b9aa-481b-9297-ea8b8b13ff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.138618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923dd14-b9aa-481b-9297-ea8b8b13ff86 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.138898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923dd14-b9aa-481b-9297-ea8b8b13ff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.139307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923dd14-b9aa-481b-9297-ea8b8b13ff86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.140052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923dd14-b9aa-481b-9297-ea8b8b13ff86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.141945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923dd14-b9aa-481b-9297-ea8b8b13ff86 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.162516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 956/1913] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:06.163793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f9a4b-5ef1-451d-84c2-a5d99f12030f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:06.182072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f9a4b-5ef1-451d-84c2-a5d99f12030f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.189382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d5891-a22e-4690-a491-9a5616eb221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.190334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d5891-a22e-4690-a491-9a5616eb221e admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.190616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d5891-a22e-4690-a491-9a5616eb221e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.190900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d5891-a22e-4690-a491-9a5616eb221e admin admin] PATH_INFO: `/v3/projects/72525967a2d940beb1254f563fbaf940/users/f8c4406e680f4d8db54d3bfc874517fd/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.207487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d5891-a22e-4690-a491-9a5616eb221e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72525967a2d940beb1254f563fbaf940, user_id=f8c4406e680f4d8db54d3bfc874517fd, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.210160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d5891-a22e-4690-a491-9a5616eb221e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.224235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 958/1914] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:06 2022] PUT /identity/v3/projects/72525967a2d940beb1254f563fbaf940/users/f8c4406e680f4d8db54d3bfc874517fd/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:06.236748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5d839-1e5f-4bcc-a33f-cb1a8896681d None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.236923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5d839-1e5f-4bcc-a33f-cb1a8896681d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.237144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5d839-1e5f-4bcc-a33f-cb1a8896681d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.271211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-2dd5d839-1e5f-4bcc-a33f-cb1a8896681d None None] MFA Rules not processed for user `f8c4406e680f4d8db54d3bfc874517fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:06.272421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-2dd5d839-1e5f-4bcc-a33f-cb1a8896681d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:06.354547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 957/1915] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:06.359314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d5891-a22e-4690-a491-9a5616eb221e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:06.412445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:06.424685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d5891-a22e-4690-a491-9a5616eb221e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.431770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6b504-7268-497f-926f-c0c964d4422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.432477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6b504-7268-497f-926f-c0c964d4422b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.432757 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6b504-7268-497f-926f-c0c964d4422b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.433028 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6b504-7268-497f-926f-c0c964d4422b admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.433722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6b504-7268-497f-926f-c0c964d4422b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.435703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6b504-7268-497f-926f-c0c964d4422b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.473322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 959/1916] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:06 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:06.475135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5d839-1e5f-4bcc-a33f-cb1a8896681d None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:06.489799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5d839-1e5f-4bcc-a33f-cb1a8896681d None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.491013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6b504-7268-497f-926f-c0c964d4422b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:06.493034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4ac6b504-7268-497f-926f-c0c964d4422b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:06.562849 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6b504-7268-497f-926f-c0c964d4422b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.568076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383ebff-ccdf-40f8-96ef-bdd1ea5d808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.569381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ebff-ccdf-40f8-96ef-bdd1ea5d808e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.569886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ebff-ccdf-40f8-96ef-bdd1ea5d808e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.570020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ebff-ccdf-40f8-96ef-bdd1ea5d808e admin admin] PATH_INFO: `/v3/users/e2564d53ce1f4b16b5a3cb8a2de32858` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.571214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383ebff-ccdf-40f8-96ef-bdd1ea5d808e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2564d53ce1f4b16b5a3cb8a2de32858)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.573126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383ebff-ccdf-40f8-96ef-bdd1ea5d808e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.574611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252b3be-aef7-4723-8ae5-e526fd4768d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.575392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b3be-aef7-4723-8ae5-e526fd4768d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.575852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b3be-aef7-4723-8ae5-e526fd4768d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.576127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b3be-aef7-4723-8ae5-e526fd4768d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.576836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252b3be-aef7-4723-8ae5-e526fd4768d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.578840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252b3be-aef7-4723-8ae5-e526fd4768d5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.608786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:06.617905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 958/1917] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:06 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:06.618802 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252b3be-aef7-4723-8ae5-e526fd4768d5 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:06.624933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b383ebff-ccdf-40f8-96ef-bdd1ea5d808e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2564d53ce1f4b16b5a3cb8a2de32858'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:06.625594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b383ebff-ccdf-40f8-96ef-bdd1ea5d808e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2564d53ce1f4b16b5a3cb8a2de32858'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:06.628623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252b3be-aef7-4723-8ae5-e526fd4768d5 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.633947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2187f83-0dd5-4b0a-9054-9e6153b5ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.634146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b383ebff-ccdf-40f8-96ef-bdd1ea5d808e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2564d53ce1f4b16b5a3cb8a2de32858'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:06.634716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2187f83-0dd5-4b0a-9054-9e6153b5ea27 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.635000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2187f83-0dd5-4b0a-9054-9e6153b5ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.635404 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2187f83-0dd5-4b0a-9054-9e6153b5ea27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.636197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2187f83-0dd5-4b0a-9054-9e6153b5ea27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.637994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2187f83-0dd5-4b0a-9054-9e6153b5ea27 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.646996 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b383ebff-ccdf-40f8-96ef-bdd1ea5d808e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2564d53ce1f4b16b5a3cb8a2de32858'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:06.648751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 959/1918] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:06.652980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2187f83-0dd5-4b0a-9054-9e6153b5ea27 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:06.657675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b383ebff-ccdf-40f8-96ef-bdd1ea5d808e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2564d53ce1f4b16b5a3cb8a2de32858'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:06.663669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2187f83-0dd5-4b0a-9054-9e6153b5ea27 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.664498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 960/1919] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:06 2022] DELETE /identity/v3/users/e2564d53ce1f4b16b5a3cb8a2de32858 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:06.669234 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f48930-228e-4f84-97ec-93f28bf2e94f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.669606 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f48930-228e-4f84-97ec-93f28bf2e94f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.669969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f48930-228e-4f84-97ec-93f28bf2e94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.689506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-99f48930-228e-4f84-97ec-93f28bf2e94f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:06.690756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-99f48930-228e-4f84-97ec-93f28bf2e94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:06.721414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f8d4e-fde5-4197-8a50-5b7dda5489e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.722342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f8d4e-fde5-4197-8a50-5b7dda5489e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.722625 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f8d4e-fde5-4197-8a50-5b7dda5489e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.722892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f8d4e-fde5-4197-8a50-5b7dda5489e1 admin admin] PATH_INFO: `/v3/projects/8b012e7a20b14ff4ab252b20459de29d/users/8a470be95dce4145a80a624e612cd80e/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.737326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f8d4e-fde5-4197-8a50-5b7dda5489e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b012e7a20b14ff4ab252b20459de29d, user_id=8a470be95dce4145a80a624e612cd80e, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.738100 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:06.740283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f8d4e-fde5-4197-8a50-5b7dda5489e1 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.753102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 961/1920] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:06.755218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 960/1921] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:06 2022] PUT /identity/v3/projects/8b012e7a20b14ff4ab252b20459de29d/users/8a470be95dce4145a80a624e612cd80e/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:06.759193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f48930-228e-4f84-97ec-93f28bf2e94f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:06.760653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-99f48930-228e-4f84-97ec-93f28bf2e94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:06.762822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f8d4e-fde5-4197-8a50-5b7dda5489e1 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:06.764467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cb0f8d4e-fde5-4197-8a50-5b7dda5489e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:06.772767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f48930-228e-4f84-97ec-93f28bf2e94f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.822877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f8d4e-fde5-4197-8a50-5b7dda5489e1 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.826569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f5584-0bc9-4b54-b86a-7d66484998dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.827227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f5584-0bc9-4b54-b86a-7d66484998dc service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.827510 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f5584-0bc9-4b54-b86a-7d66484998dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.827782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f5584-0bc9-4b54-b86a-7d66484998dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.828869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223af38a-de06-4fbe-a0d6-2b1f3f4f56fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.829538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af38a-de06-4fbe-a0d6-2b1f3f4f56fd admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.829845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af38a-de06-4fbe-a0d6-2b1f3f4f56fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.830120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af38a-de06-4fbe-a0d6-2b1f3f4f56fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.830887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223af38a-de06-4fbe-a0d6-2b1f3f4f56fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.832505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223af38a-de06-4fbe-a0d6-2b1f3f4f56fd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.837137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f5584-0bc9-4b54-b86a-7d66484998dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.838580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f5584-0bc9-4b54-b86a-7d66484998dc service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.842370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 962/1922] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:06.847183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223af38a-de06-4fbe-a0d6-2b1f3f4f56fd admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:06.848715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 961/1923] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:18:06.857428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223af38a-de06-4fbe-a0d6-2b1f3f4f56fd admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:06.862714 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae283d-1e77-46cf-9fa1-4951f3b1094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:06.863605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae283d-1e77-46cf-9fa1-4951f3b1094f admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.863882 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae283d-1e77-46cf-9fa1-4951f3b1094f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.864165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae283d-1e77-46cf-9fa1-4951f3b1094f admin admin] PATH_INFO: `/v3/projects/8b012e7a20b14ff4ab252b20459de29d/users/8a470be95dce4145a80a624e612cd80e/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.866193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae283d-1e77-46cf-9fa1-4951f3b1094f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b012e7a20b14ff4ab252b20459de29d, user_id=8a470be95dce4145a80a624e612cd80e, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:06.869060 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae283d-1e77-46cf-9fa1-4951f3b1094f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:06.880181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 963/1924] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:06 2022] PUT /identity/v3/projects/8b012e7a20b14ff4ab252b20459de29d/users/8a470be95dce4145a80a624e612cd80e/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:06.890457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d422c-6420-4cbe-b942-6ac8515631b2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:06.890753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d422c-6420-4cbe-b942-6ac8515631b2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:06.891035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d422c-6420-4cbe-b942-6ac8515631b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:06.920227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-1f3d422c-6420-4cbe-b942-6ac8515631b2 None None] MFA Rules not processed for user `8a470be95dce4145a80a624e612cd80e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:06.921472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1f3d422c-6420-4cbe-b942-6ac8515631b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:06.998623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:07.004132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 962/1925] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:07.017391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae283d-1e77-46cf-9fa1-4951f3b1094f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:07.019182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f6ae283d-1e77-46cf-9fa1-4951f3b1094f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:07.101580 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae283d-1e77-46cf-9fa1-4951f3b1094f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:07.105890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e3c1-a976-4d1c-aa4d-2f8b665f4524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:07.106593 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e3c1-a976-4d1c-aa4d-2f8b665f4524 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:07.106873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e3c1-a976-4d1c-aa4d-2f8b665f4524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:07.107146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e3c1-a976-4d1c-aa4d-2f8b665f4524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:07.118916 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84e3c1-a976-4d1c-aa4d-2f8b665f4524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:07.121044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84e3c1-a976-4d1c-aa4d-2f8b665f4524 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:07.134283 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 964/1926] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:07.251646 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d422c-6420-4cbe-b942-6ac8515631b2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:07.253082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1f3d422c-6420-4cbe-b942-6ac8515631b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:07.431672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e3c1-a976-4d1c-aa4d-2f8b665f4524 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:07.433087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0c84e3c1-a976-4d1c-aa4d-2f8b665f4524 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:07.446972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e3c1-a976-4d1c-aa4d-2f8b665f4524 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:07.450989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d427987-ce1b-4dfa-9f7e-cc9bd1c60a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:07.451704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d427987-ce1b-4dfa-9f7e-cc9bd1c60a9d service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:07.451983 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d427987-ce1b-4dfa-9f7e-cc9bd1c60a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:07.452428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d427987-ce1b-4dfa-9f7e-cc9bd1c60a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:07.454530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2d427987-ce1b-4dfa-9f7e-cc9bd1c60a9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:07.464904 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d422c-6420-4cbe-b942-6ac8515631b2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:07.470994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:07.472094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:07.472433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:07.472777 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] PATH_INFO: `/v3/projects/564cc9d1349a424abf79c9743487ebfd` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:07.482099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=564cc9d1349a424abf79c9743487ebfd)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:07.482099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:07.548076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d427987-ce1b-4dfa-9f7e-cc9bd1c60a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:07.550547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d427987-ce1b-4dfa-9f7e-cc9bd1c60a9d service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:07.556275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564cc9d1349a424abf79c9743487ebfd', 'request_id': 'req-41d56c22-845f-4108-9077-2aa006144364'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:07.565402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564cc9d1349a424abf79c9743487ebfd', 'request_id': 'req-41d56c22-845f-4108-9077-2aa006144364'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:07.571088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 965/1927] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:18:07.576151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564cc9d1349a424abf79c9743487ebfd', 'request_id': 'req-41d56c22-845f-4108-9077-2aa006144364'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:07.595032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] The token cache is being invalidate because project 564cc9d1349a424abf79c9743487ebfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:07.595461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:07.596970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-41d56c22-845f-4108-9077-2aa006144364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:07.622404 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 963/1928] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:07 2022] DELETE /identity/v3/projects/564cc9d1349a424abf79c9743487ebfd => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:07.627000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ced4-2bc3-44ae-bda8-4cdd679ad630 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:07.627286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ced4-2bc3-44ae-bda8-4cdd679ad630 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:07.627567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ced4-2bc3-44ae-bda8-4cdd679ad630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:07.661191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d378ced4-2bc3-44ae-bda8-4cdd679ad630 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:07.664557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d378ced4-2bc3-44ae-bda8-4cdd679ad630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:07.713086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:07.844488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 966/1929] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:07.853926 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aed8d8-840a-428f-8435-7e047649b91f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:07.854523 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aed8d8-840a-428f-8435-7e047649b91f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:07.854628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aed8d8-840a-428f-8435-7e047649b91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:07.899628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-c9aed8d8-840a-428f-8435-7e047649b91f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:07.902946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c9aed8d8-840a-428f-8435-7e047649b91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:07.932998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ced4-2bc3-44ae-bda8-4cdd679ad630 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:07.933304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 964/1930] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:07.957870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ced4-2bc3-44ae-bda8-4cdd679ad630 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:07.964324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05096d8-e205-487c-9a53-d141ff18f616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:07.965211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05096d8-e205-487c-9a53-d141ff18f616 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:07.965565 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05096d8-e205-487c-9a53-d141ff18f616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:07.965976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05096d8-e205-487c-9a53-d141ff18f616 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:07.967022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05096d8-e205-487c-9a53-d141ff18f616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:07.967291 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05096d8-e205-487c-9a53-d141ff18f616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:07.969354 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05096d8-e205-487c-9a53-d141ff18f616 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.013905 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 967/1931] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:18:08.015091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aed8d8-840a-428f-8435-7e047649b91f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:08.026406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aed8d8-840a-428f-8435-7e047649b91f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:08.048632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54756b7c-2d5a-4930-bc04-1662d9156aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:08.048632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54756b7c-2d5a-4930-bc04-1662d9156aba admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.048632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54756b7c-2d5a-4930-bc04-1662d9156aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.048632 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54756b7c-2d5a-4930-bc04-1662d9156aba admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.049065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54756b7c-2d5a-4930-bc04-1662d9156aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:08.052019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54756b7c-2d5a-4930-bc04-1662d9156aba admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.113878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 965/1932] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:08 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:08.120500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05096d8-e205-487c-9a53-d141ff18f616 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:08.138501 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05096d8-e205-487c-9a53-d141ff18f616 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:08.267605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a666c1-255f-45c3-a726-2758ce13f37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:08.268314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a666c1-255f-45c3-a726-2758ce13f37d admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.268594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a666c1-255f-45c3-a726-2758ce13f37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.269534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a666c1-255f-45c3-a726-2758ce13f37d admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.269931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a666c1-255f-45c3-a726-2758ce13f37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:08.271978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a666c1-255f-45c3-a726-2758ce13f37d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.303603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 968/1933] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:08 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:08.304195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54756b7c-2d5a-4930-bc04-1662d9156aba admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:08.316488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54756b7c-2d5a-4930-bc04-1662d9156aba admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:08.321555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db452b69-64ee-4639-a2a1-f45c513f7dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:08.322343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db452b69-64ee-4639-a2a1-f45c513f7dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.322696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db452b69-64ee-4639-a2a1-f45c513f7dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.322995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db452b69-64ee-4639-a2a1-f45c513f7dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.323769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db452b69-64ee-4639-a2a1-f45c513f7dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:08.325460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db452b69-64ee-4639-a2a1-f45c513f7dcd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.337205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 966/1934] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:08.341452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a666c1-255f-45c3-a726-2758ce13f37d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:08.352539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a666c1-255f-45c3-a726-2758ce13f37d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:08.357840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cc318-7e10-4ac8-93d9-6862ca0cff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:08.358564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cc318-7e10-4ac8-93d9-6862ca0cff2e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.358871 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cc318-7e10-4ac8-93d9-6862ca0cff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.359145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cc318-7e10-4ac8-93d9-6862ca0cff2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.359885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cc318-7e10-4ac8-93d9-6862ca0cff2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:08.361808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cc318-7e10-4ac8-93d9-6862ca0cff2e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.372160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 969/1935] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:08.376435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db452b69-64ee-4639-a2a1-f45c513f7dcd admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:08.386793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db452b69-64ee-4639-a2a1-f45c513f7dcd admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:08.391423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5f066-ba72-4638-84a4-4b871c3ae0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:08.392339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f066-ba72-4638-84a4-4b871c3ae0f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.392697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f066-ba72-4638-84a4-4b871c3ae0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.392980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f066-ba72-4638-84a4-4b871c3ae0f6 admin admin] PATH_INFO: `/v3/projects/edc1e38bc239427f834648a0ae8ea3e5/users/eb743949c29c42879604a519593f56f9/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.409498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5f066-ba72-4638-84a4-4b871c3ae0f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc1e38bc239427f834648a0ae8ea3e5, user_id=eb743949c29c42879604a519593f56f9, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:08.412150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5f066-ba72-4638-84a4-4b871c3ae0f6 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.426841 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 967/1936] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:08 2022] PUT /identity/v3/projects/edc1e38bc239427f834648a0ae8ea3e5/users/eb743949c29c42879604a519593f56f9/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:08.437085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9c4a4-ba1b-49b5-a56e-828a16fde801 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.437567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9c4a4-ba1b-49b5-a56e-828a16fde801 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.438236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9c4a4-ba1b-49b5-a56e-828a16fde801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.467416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-cff9c4a4-ba1b-49b5-a56e-828a16fde801 None None] MFA Rules not processed for user `eb743949c29c42879604a519593f56f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:08.468770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cff9c4a4-ba1b-49b5-a56e-828a16fde801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:08.545789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 970/1937] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:08.550796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5f066-ba72-4638-84a4-4b871c3ae0f6 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:08.583558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:08.641110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5f066-ba72-4638-84a4-4b871c3ae0f6 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:08.646075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9b5d7-b871-450d-a0c0-4faf085091d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:08.647148 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b5d7-b871-450d-a0c0-4faf085091d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.647148 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b5d7-b871-450d-a0c0-4faf085091d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.647341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b5d7-b871-450d-a0c0-4faf085091d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.648018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9b5d7-b871-450d-a0c0-4faf085091d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:08.649973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9b5d7-b871-450d-a0c0-4faf085091d1 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.684111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 968/1938] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:08 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:08.685674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9c4a4-ba1b-49b5-a56e-828a16fde801 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:08.700650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9c4a4-ba1b-49b5-a56e-828a16fde801 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:08.714838 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:08.765134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702a897-ed96-41c0-9c84-212ca52b5f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:08.765884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702a897-ed96-41c0-9c84-212ca52b5f83 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.766255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702a897-ed96-41c0-9c84-212ca52b5f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.766858 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702a897-ed96-41c0-9c84-212ca52b5f83 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.767790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702a897-ed96-41c0-9c84-212ca52b5f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:08.770148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702a897-ed96-41c0-9c84-212ca52b5f83 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.796750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 971/1939] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:08 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:08.799534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9b5d7-b871-450d-a0c0-4faf085091d1 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:08.812580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9b5d7-b871-450d-a0c0-4faf085091d1 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:08.817808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3987a73-cff5-4c3f-bda3-fe49353bc8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:08.818537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3987a73-cff5-4c3f-bda3-fe49353bc8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.818823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3987a73-cff5-4c3f-bda3-fe49353bc8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.819101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3987a73-cff5-4c3f-bda3-fe49353bc8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.819850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3987a73-cff5-4c3f-bda3-fe49353bc8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:08.822185 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3987a73-cff5-4c3f-bda3-fe49353bc8e8 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.839898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 969/1940] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:08.844894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702a897-ed96-41c0-9c84-212ca52b5f83 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:08.858517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702a897-ed96-41c0-9c84-212ca52b5f83 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:08.865307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3987a73-cff5-4c3f-bda3-fe49353bc8e8 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:08.867142 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e3987a73-cff5-4c3f-bda3-fe49353bc8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:08.874102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cc933-dde4-4f97-8a01-7e182630dd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:08.874936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cc933-dde4-4f97-8a01-7e182630dd35 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.875281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cc933-dde4-4f97-8a01-7e182630dd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.875620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cc933-dde4-4f97-8a01-7e182630dd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.877351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cc933-dde4-4f97-8a01-7e182630dd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:08.881930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cc933-dde4-4f97-8a01-7e182630dd35 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.883713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3987a73-cff5-4c3f-bda3-fe49353bc8e8 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:08.889687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8875d-cab6-471c-bf6e-0c6a80c93009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:08.890760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8875d-cab6-471c-bf6e-0c6a80c93009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.891120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8875d-cab6-471c-bf6e-0c6a80c93009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.891427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8875d-cab6-471c-bf6e-0c6a80c93009 admin admin] PATH_INFO: `/v3/users/dd44529f7fbd454e8d5831fa8d7fdb67` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.892732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8875d-cab6-471c-bf6e-0c6a80c93009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd44529f7fbd454e8d5831fa8d7fdb67)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:08.895464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8875d-cab6-471c-bf6e-0c6a80c93009 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.914684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 972/1941] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:08.918841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cc933-dde4-4f97-8a01-7e182630dd35 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:08.932869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cc933-dde4-4f97-8a01-7e182630dd35 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:08.938427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cd33b-0587-43a9-890d-bf96a0be0be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:08.940244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cd33b-0587-43a9-890d-bf96a0be0be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:08.940599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cd33b-0587-43a9-890d-bf96a0be0be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:08.940924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cd33b-0587-43a9-890d-bf96a0be0be9 admin admin] PATH_INFO: `/v3/projects/5886a5750d3140d79bb5e218d4a2ea78/users/be1e467479084de7baba869726eaffbb/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:08.970730 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cd33b-0587-43a9-890d-bf96a0be0be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5886a5750d3140d79bb5e218d4a2ea78, user_id=be1e467479084de7baba869726eaffbb, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:08.990110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cd33b-0587-43a9-890d-bf96a0be0be9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:08.998236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-71d8875d-cab6-471c-bf6e-0c6a80c93009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd44529f7fbd454e8d5831fa8d7fdb67'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:08.998966 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-71d8875d-cab6-471c-bf6e-0c6a80c93009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd44529f7fbd454e8d5831fa8d7fdb67'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:09.035823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 973/1942] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:08 2022] PUT /identity/v3/projects/5886a5750d3140d79bb5e218d4a2ea78/users/be1e467479084de7baba869726eaffbb/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:09.036174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-71d8875d-cab6-471c-bf6e-0c6a80c93009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd44529f7fbd454e8d5831fa8d7fdb67'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:09.040634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912913-3b8b-4959-85b4-9537d838dd57 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:09.040917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912913-3b8b-4959-85b4-9537d838dd57 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:09.041210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912913-3b8b-4959-85b4-9537d838dd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:09.056451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-71d8875d-cab6-471c-bf6e-0c6a80c93009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd44529f7fbd454e8d5831fa8d7fdb67'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:09.097492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-71d8875d-cab6-471c-bf6e-0c6a80c93009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd44529f7fbd454e8d5831fa8d7fdb67'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:09.107228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-79912913-3b8b-4959-85b4-9537d838dd57 None None] MFA Rules not processed for user `be1e467479084de7baba869726eaffbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:09.108847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-79912913-3b8b-4959-85b4-9537d838dd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:09.120892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 970/1943] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:08 2022] DELETE /identity/v3/users/dd44529f7fbd454e8d5831fa8d7fdb67 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:09.130891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775a120-8fb5-419e-8cfa-cf62faafda71 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:09.131232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775a120-8fb5-419e-8cfa-cf62faafda71 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:09.135520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775a120-8fb5-419e-8cfa-cf62faafda71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:09.193726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7775a120-8fb5-419e-8cfa-cf62faafda71 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:09.199428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7775a120-8fb5-419e-8cfa-cf62faafda71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:09.307454 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 974/1944] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:09.309355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79912913-3b8b-4959-85b4-9537d838dd57 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:09.321199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-79912913-3b8b-4959-85b4-9537d838dd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:09.396455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 971/1945] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:09.398184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775a120-8fb5-419e-8cfa-cf62faafda71 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:09.401105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7775a120-8fb5-419e-8cfa-cf62faafda71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:09.446028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:09.457660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79912913-3b8b-4959-85b4-9537d838dd57 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:09.466791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4e219-10f9-4f85-8ca3-27efd4c373e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:09.468302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4e219-10f9-4f85-8ca3-27efd4c373e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:09.468652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4e219-10f9-4f85-8ca3-27efd4c373e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:09.468932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4e219-10f9-4f85-8ca3-27efd4c373e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:09.471451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4e219-10f9-4f85-8ca3-27efd4c373e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:09.473790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4e219-10f9-4f85-8ca3-27efd4c373e0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:09.479892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:09.521829 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 975/1946] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:09 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:09.526865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4e219-10f9-4f85-8ca3-27efd4c373e0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:09.552088 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775a120-8fb5-419e-8cfa-cf62faafda71 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:09.622336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdb108-7ddb-40c3-838a-27c5c5819a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:09.623205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdb108-7ddb-40c3-838a-27c5c5819a0e service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:09.623525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdb108-7ddb-40c3-838a-27c5c5819a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:09.623795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdb108-7ddb-40c3-838a-27c5c5819a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:09.628843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4e219-10f9-4f85-8ca3-27efd4c373e0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:09.635603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59a2f1-2667-4c4e-bead-7039cbc030b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:09.636853 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59a2f1-2667-4c4e-bead-7039cbc030b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:09.637132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59a2f1-2667-4c4e-bead-7039cbc030b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:09.637396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59a2f1-2667-4c4e-bead-7039cbc030b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:09.638092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59a2f1-2667-4c4e-bead-7039cbc030b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:09.646062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59a2f1-2667-4c4e-bead-7039cbc030b6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:09.649893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdb108-7ddb-40c3-838a-27c5c5819a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:09.651406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdb108-7ddb-40c3-838a-27c5c5819a0e service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:09.691916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 972/1947] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:09.699361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 976/1948] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:09 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:09.703620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdb108-7ddb-40c3-838a-27c5c5819a0e service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:09.720423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdb108-7ddb-40c3-838a-27c5c5819a0e service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:09.734032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd3dcc-aa54-4508-9065-3b15cefeb29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:09.734938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3dcc-aa54-4508-9065-3b15cefeb29f admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:09.740669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3dcc-aa54-4508-9065-3b15cefeb29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:09.741170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3dcc-aa54-4508-9065-3b15cefeb29f admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:09.742105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd3dcc-aa54-4508-9065-3b15cefeb29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:09.743890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd3dcc-aa54-4508-9065-3b15cefeb29f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:09.767912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 973/1949] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:09.771609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59a2f1-2667-4c4e-bead-7039cbc030b6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:09.801139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59a2f1-2667-4c4e-bead-7039cbc030b6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:09.813163 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6781fd-a68c-4a45-afc1-e159b9b6593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:09.814445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6781fd-a68c-4a45-afc1-e159b9b6593a admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:09.814841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6781fd-a68c-4a45-afc1-e159b9b6593a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:09.815236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6781fd-a68c-4a45-afc1-e159b9b6593a admin admin] PATH_INFO: `/v3/projects/b7ef630261d247a6be09c31486092cbb/users/076b23429a514ae292d5a5478c1a57d2/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:09.849719 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6781fd-a68c-4a45-afc1-e159b9b6593a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ef630261d247a6be09c31486092cbb, user_id=076b23429a514ae292d5a5478c1a57d2, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:09.855012 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6781fd-a68c-4a45-afc1-e159b9b6593a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:09.882218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 977/1950] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:09 2022] PUT /identity/v3/projects/b7ef630261d247a6be09c31486092cbb/users/076b23429a514ae292d5a5478c1a57d2/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:09.885040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd3dcc-aa54-4508-9065-3b15cefeb29f admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:09.905741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd3dcc-aa54-4508-9065-3b15cefeb29f admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:09.994983 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044244ac-d5c5-40bb-9fd5-fa1189354907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:09.995767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044244ac-d5c5-40bb-9fd5-fa1189354907 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:09.996140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044244ac-d5c5-40bb-9fd5-fa1189354907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:09.996495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044244ac-d5c5-40bb-9fd5-fa1189354907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:09.997440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044244ac-d5c5-40bb-9fd5-fa1189354907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:09.999064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044244ac-d5c5-40bb-9fd5-fa1189354907 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:10.015593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 974/1951] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:10.016930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6781fd-a68c-4a45-afc1-e159b9b6593a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:10.027927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6781fd-a68c-4a45-afc1-e159b9b6593a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:10.033826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231f748-6272-4100-b2d6-264ed81b9134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:10.035199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f748-6272-4100-b2d6-264ed81b9134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:10.035199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f748-6272-4100-b2d6-264ed81b9134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:10.035494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f748-6272-4100-b2d6-264ed81b9134 admin admin] PATH_INFO: `/v3/projects/b7ef630261d247a6be09c31486092cbb/users/076b23429a514ae292d5a5478c1a57d2/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:10.038103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231f748-6272-4100-b2d6-264ed81b9134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ef630261d247a6be09c31486092cbb, user_id=076b23429a514ae292d5a5478c1a57d2, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:10.041104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231f748-6272-4100-b2d6-264ed81b9134 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:10.062977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 978/1952] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:10 2022] PUT /identity/v3/projects/b7ef630261d247a6be09c31486092cbb/users/076b23429a514ae292d5a5478c1a57d2/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:10.066653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0b4e0-9792-4a6e-b709-7c07a8953d8f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:10.066941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0b4e0-9792-4a6e-b709-7c07a8953d8f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:10.067215 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0b4e0-9792-4a6e-b709-7c07a8953d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:10.098966 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-b0b0b4e0-9792-4a6e-b709-7c07a8953d8f None None] MFA Rules not processed for user `076b23429a514ae292d5a5478c1a57d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:10.100320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b0b0b4e0-9792-4a6e-b709-7c07a8953d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:10.145918 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231f748-6272-4100-b2d6-264ed81b9134 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:10.148917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6231f748-6272-4100-b2d6-264ed81b9134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:10.161641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:10.203720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 975/1953] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:10.215561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0b4e0-9792-4a6e-b709-7c07a8953d8f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:10.217180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b0b0b4e0-9792-4a6e-b709-7c07a8953d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:10.241742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231f748-6272-4100-b2d6-264ed81b9134 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:10.248155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:10.249327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:10.249327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:10.249587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] PATH_INFO: `/v3/projects/a04659a2b12b48c3baa2fd626f9e8b98` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:10.250922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04659a2b12b48c3baa2fd626f9e8b98)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:10.252998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:10.290594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0b4e0-9792-4a6e-b709-7c07a8953d8f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:10.297313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:10.309039 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04659a2b12b48c3baa2fd626f9e8b98', 'request_id': 'req-d9d0cfd3-957e-4184-8e1e-4af679865f37'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:10.318149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04659a2b12b48c3baa2fd626f9e8b98', 'request_id': 'req-d9d0cfd3-957e-4184-8e1e-4af679865f37'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:10.328561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04659a2b12b48c3baa2fd626f9e8b98', 'request_id': 'req-d9d0cfd3-957e-4184-8e1e-4af679865f37'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:10.343761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] The token cache is being invalidate because project a04659a2b12b48c3baa2fd626f9e8b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:10.344276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:10.345170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:10.348106 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bef17-93f4-4aad-8f0d-e63e3d3ad248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:10.348778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bef17-93f4-4aad-8f0d-e63e3d3ad248 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:10.349066 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bef17-93f4-4aad-8f0d-e63e3d3ad248 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:10.350199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bef17-93f4-4aad-8f0d-e63e3d3ad248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:10.350801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 979/1954] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:10 2022] DELETE /identity/v3/projects/a04659a2b12b48c3baa2fd626f9e8b98 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:10.351906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:10.353230 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:10.354542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-317bef17-93f4-4aad-8f0d-e63e3d3ad248 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:10.449239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bef17-93f4-4aad-8f0d-e63e3d3ad248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:10.451147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bef17-93f4-4aad-8f0d-e63e3d3ad248 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:10.463550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0cfd3-957e-4184-8e1e-4af679865f37 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:10.469251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82502dd9-4060-4d8c-96c3-5e2abcd3efd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:10.470464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82502dd9-4060-4d8c-96c3-5e2abcd3efd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:10.470893 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82502dd9-4060-4d8c-96c3-5e2abcd3efd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:10.471327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82502dd9-4060-4d8c-96c3-5e2abcd3efd0 admin admin] PATH_INFO: `/v3/users/e21d38d818d145ff9f17df2d2393c44f` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:10.473061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82502dd9-4060-4d8c-96c3-5e2abcd3efd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21d38d818d145ff9f17df2d2393c44f)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:10.474933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 976/1955] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:10.476026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82502dd9-4060-4d8c-96c3-5e2abcd3efd0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:10.552045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-82502dd9-4060-4d8c-96c3-5e2abcd3efd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21d38d818d145ff9f17df2d2393c44f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:10.553820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-82502dd9-4060-4d8c-96c3-5e2abcd3efd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21d38d818d145ff9f17df2d2393c44f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:10.570010 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-82502dd9-4060-4d8c-96c3-5e2abcd3efd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21d38d818d145ff9f17df2d2393c44f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:10.600421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-82502dd9-4060-4d8c-96c3-5e2abcd3efd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21d38d818d145ff9f17df2d2393c44f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:10.620435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-82502dd9-4060-4d8c-96c3-5e2abcd3efd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21d38d818d145ff9f17df2d2393c44f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:10.639839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 980/1956] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:10 2022] DELETE /identity/v3/users/e21d38d818d145ff9f17df2d2393c44f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:11.068071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bef17-93f4-4aad-8f0d-e63e3d3ad248 service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:11.088177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bef17-93f4-4aad-8f0d-e63e3d3ad248 service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:11.211553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:11.244446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:11.246595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:11.249156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:11.249666 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] PATH_INFO: `/v3/projects/8b236b09dc1144d79941534b7386b01f` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:11.253433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b236b09dc1144d79941534b7386b01f)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:11.261499 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:11.332082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b236b09dc1144d79941534b7386b01f', 'request_id': 'req-43ee9f0c-b3f6-4937-bf71-7c8566225024'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:11.339532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b236b09dc1144d79941534b7386b01f', 'request_id': 'req-43ee9f0c-b3f6-4937-bf71-7c8566225024'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:11.350114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b236b09dc1144d79941534b7386b01f', 'request_id': 'req-43ee9f0c-b3f6-4937-bf71-7c8566225024'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:11.366507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] The token cache is being invalidate because project 8b236b09dc1144d79941534b7386b01f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:11.367565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:11.371070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-43ee9f0c-b3f6-4937-bf71-7c8566225024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:11.382795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 977/1957] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:11 2022] DELETE /identity/v3/projects/8b236b09dc1144d79941534b7386b01f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:11.384553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7814b6-0ed6-407b-9c0e-53a661df6376 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:11.384869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7814b6-0ed6-407b-9c0e-53a661df6376 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:11.385149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7814b6-0ed6-407b-9c0e-53a661df6376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:11.427801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4e7814b6-0ed6-407b-9c0e-53a661df6376 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:11.430257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4e7814b6-0ed6-407b-9c0e-53a661df6376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:11.522592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:11.558703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 981/1958] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:11.571072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ee548-5b8e-4e46-881d-33a277f85763 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:11.571477 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ee548-5b8e-4e46-881d-33a277f85763 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:11.572164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ee548-5b8e-4e46-881d-33a277f85763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:11.594513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-a18ee548-5b8e-4e46-881d-33a277f85763 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:11.594513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a18ee548-5b8e-4e46-881d-33a277f85763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:11.610745 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 978/1959] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:11.612616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7814b6-0ed6-407b-9c0e-53a661df6376 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:11.622656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7814b6-0ed6-407b-9c0e-53a661df6376 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:11.627593 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bf58e-b7cb-4de7-b794-6129eb18ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:11.628552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bf58e-b7cb-4de7-b794-6129eb18ab32 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:11.628833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bf58e-b7cb-4de7-b794-6129eb18ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:11.629106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bf58e-b7cb-4de7-b794-6129eb18ab32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:11.629846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bf58e-b7cb-4de7-b794-6129eb18ab32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:11.630176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bf58e-b7cb-4de7-b794-6129eb18ab32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:11.632267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bf58e-b7cb-4de7-b794-6129eb18ab32 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:11.650344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 982/1960] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:18:11.654753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ee548-5b8e-4e46-881d-33a277f85763 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:11.666625 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ee548-5b8e-4e46-881d-33a277f85763 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:11.671924 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a47d3-006d-4c1e-960c-a555080f9a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:11.672870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a47d3-006d-4c1e-960c-a555080f9a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:11.673246 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a47d3-006d-4c1e-960c-a555080f9a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:11.673711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a47d3-006d-4c1e-960c-a555080f9a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:11.675082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a47d3-006d-4c1e-960c-a555080f9a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:11.677228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a47d3-006d-4c1e-960c-a555080f9a70 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:11.711928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 979/1961] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:11 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:11.712698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bf58e-b7cb-4de7-b794-6129eb18ab32 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:11.724100 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bf58e-b7cb-4de7-b794-6129eb18ab32 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:11.793654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39535419-c048-431e-b335-65c0f4b1556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:11.794814 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535419-c048-431e-b335-65c0f4b1556a admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:11.794917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535419-c048-431e-b335-65c0f4b1556a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:11.795184 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535419-c048-431e-b335-65c0f4b1556a admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:11.796196 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39535419-c048-431e-b335-65c0f4b1556a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:11.798721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39535419-c048-431e-b335-65c0f4b1556a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:11.823945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 983/1962] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:11 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:11.827763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a47d3-006d-4c1e-960c-a555080f9a70 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:11.840699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a47d3-006d-4c1e-960c-a555080f9a70 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:11.847355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c6d37-73b8-44ba-bc8a-2f0aeaf261da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:11.848051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c6d37-73b8-44ba-bc8a-2f0aeaf261da admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:11.848333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c6d37-73b8-44ba-bc8a-2f0aeaf261da admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:11.848608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c6d37-73b8-44ba-bc8a-2f0aeaf261da admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:11.849708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c6d37-73b8-44ba-bc8a-2f0aeaf261da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:11.851422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c6d37-73b8-44ba-bc8a-2f0aeaf261da admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:11.867463 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 980/1963] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:11.868727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39535419-c048-431e-b335-65c0f4b1556a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:11.882801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39535419-c048-431e-b335-65c0f4b1556a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:11.888241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e8d2b-ae89-4c82-8a15-2d923218319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:11.888935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e8d2b-ae89-4c82-8a15-2d923218319e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:11.889218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e8d2b-ae89-4c82-8a15-2d923218319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:11.889495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e8d2b-ae89-4c82-8a15-2d923218319e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:11.890238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e8d2b-ae89-4c82-8a15-2d923218319e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:11.892309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e8d2b-ae89-4c82-8a15-2d923218319e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:11.903842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 984/1964] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:11.909298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c6d37-73b8-44ba-bc8a-2f0aeaf261da admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:11.920856 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c6d37-73b8-44ba-bc8a-2f0aeaf261da admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:11.930339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb552e0-f81d-4ab6-bc14-b37c1009d2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:11.930730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb552e0-f81d-4ab6-bc14-b37c1009d2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:11.930992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb552e0-f81d-4ab6-bc14-b37c1009d2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:11.931271 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb552e0-f81d-4ab6-bc14-b37c1009d2d6 admin admin] PATH_INFO: `/v3/projects/7294a26c10514490a294a7cecbe343d3/users/adca47c80f144b6d9c54969feb7a0539/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:11.947698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb552e0-f81d-4ab6-bc14-b37c1009d2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7294a26c10514490a294a7cecbe343d3, user_id=adca47c80f144b6d9c54969feb7a0539, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:11.950473 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb552e0-f81d-4ab6-bc14-b37c1009d2d6 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:11.965006 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 981/1965] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:11 2022] PUT /identity/v3/projects/7294a26c10514490a294a7cecbe343d3/users/adca47c80f144b6d9c54969feb7a0539/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:11.978126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d184f-9db6-4508-a6d4-cf53a56a3f78 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:11.978454 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d184f-9db6-4508-a6d4-cf53a56a3f78 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:11.978736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d184f-9db6-4508-a6d4-cf53a56a3f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:12.011988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fb1d184f-9db6-4508-a6d4-cf53a56a3f78 None None] MFA Rules not processed for user `adca47c80f144b6d9c54969feb7a0539`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:12.014058 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fb1d184f-9db6-4508-a6d4-cf53a56a3f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:12.153806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 985/1966] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:12.159477 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb552e0-f81d-4ab6-bc14-b37c1009d2d6 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:12.312004 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb552e0-f81d-4ab6-bc14-b37c1009d2d6 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:12.326355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f621d-1796-44fc-a750-4ec57f8a8247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:12.327058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f621d-1796-44fc-a750-4ec57f8a8247 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:12.327338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f621d-1796-44fc-a750-4ec57f8a8247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:12.327610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f621d-1796-44fc-a750-4ec57f8a8247 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:12.328392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f621d-1796-44fc-a750-4ec57f8a8247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:12.331554 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f621d-1796-44fc-a750-4ec57f8a8247 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:12.426529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 982/1967] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:12 2022] POST /identity/v3/projects => generated 381 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:12.426827 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d184f-9db6-4508-a6d4-cf53a56a3f78 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:12.443628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d184f-9db6-4508-a6d4-cf53a56a3f78 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:12.584353 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:12.648302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba82b-98d0-4e7d-9b05-e4fbbcfd8f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:12.649365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba82b-98d0-4e7d-9b05-e4fbbcfd8f28 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:12.649844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba82b-98d0-4e7d-9b05-e4fbbcfd8f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:12.650277 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba82b-98d0-4e7d-9b05-e4fbbcfd8f28 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:12.651234 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ba82b-98d0-4e7d-9b05-e4fbbcfd8f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:12.654781 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ba82b-98d0-4e7d-9b05-e4fbbcfd8f28 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:12.701037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f621d-1796-44fc-a750-4ec57f8a8247 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:12.702959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a74f621d-1796-44fc-a750-4ec57f8a8247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:12.703466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 986/1968] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:12 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:12.709277 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba82b-98d0-4e7d-9b05-e4fbbcfd8f28 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:12.716222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:12.748591 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba82b-98d0-4e7d-9b05-e4fbbcfd8f28 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:12.761435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c7489-99df-4896-a96b-f8c14b1952ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:12.762220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c7489-99df-4896-a96b-f8c14b1952ed admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:12.762524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c7489-99df-4896-a96b-f8c14b1952ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:12.763261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c7489-99df-4896-a96b-f8c14b1952ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:12.766098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c7489-99df-4896-a96b-f8c14b1952ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:12.770901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c7489-99df-4896-a96b-f8c14b1952ed admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:12.794967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 987/1969] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:12.800499 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c7489-99df-4896-a96b-f8c14b1952ed admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:12.833591 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c7489-99df-4896-a96b-f8c14b1952ed admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:12.841239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e92f09-2160-46fe-8b7f-dd1ac65df1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:12.842500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e92f09-2160-46fe-8b7f-dd1ac65df1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:12.842952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e92f09-2160-46fe-8b7f-dd1ac65df1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:12.843309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e92f09-2160-46fe-8b7f-dd1ac65df1fd admin admin] PATH_INFO: `/v3/projects/1bce07b4b3cf4ff69aed492af635495c/users/8740d2bd12094afca7e1e04a32276e9f/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:12.850273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f621d-1796-44fc-a750-4ec57f8a8247 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:12.861723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b39d0-bf92-4d7b-b4b6-6bd9b5b20ba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:12.862616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b39d0-bf92-4d7b-b4b6-6bd9b5b20ba8 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:12.862995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b39d0-bf92-4d7b-b4b6-6bd9b5b20ba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:12.863281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b39d0-bf92-4d7b-b4b6-6bd9b5b20ba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:12.865517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7d1b39d0-bf92-4d7b-b4b6-6bd9b5b20ba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:12.868767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e92f09-2160-46fe-8b7f-dd1ac65df1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bce07b4b3cf4ff69aed492af635495c, user_id=8740d2bd12094afca7e1e04a32276e9f, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:12.871803 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e92f09-2160-46fe-8b7f-dd1ac65df1fd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:12.895561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 988/1970] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:12 2022] PUT /identity/v3/projects/1bce07b4b3cf4ff69aed492af635495c/users/8740d2bd12094afca7e1e04a32276e9f/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:12.899365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e92f09-2160-46fe-8b7f-dd1ac65df1fd admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:12.980968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b39d0-bf92-4d7b-b4b6-6bd9b5b20ba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:12.991572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b39d0-bf92-4d7b-b4b6-6bd9b5b20ba8 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:13.005744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e92f09-2160-46fe-8b7f-dd1ac65df1fd admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:13.011055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53e777-5114-4453-8876-3b36dc4e9974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:13.011988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53e777-5114-4453-8876-3b36dc4e9974 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:13.015279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53e777-5114-4453-8876-3b36dc4e9974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:13.015279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53e777-5114-4453-8876-3b36dc4e9974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:13.015514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 983/1971] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:18:13.015610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53e777-5114-4453-8876-3b36dc4e9974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:13.015610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53e777-5114-4453-8876-3b36dc4e9974 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:13.028816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 989/1972] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:13.033396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b39d0-bf92-4d7b-b4b6-6bd9b5b20ba8 service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:13.046408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b39d0-bf92-4d7b-b4b6-6bd9b5b20ba8 service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:13.055197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481b40f-fb93-49c2-95a3-f3990a4bf228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:13.056384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481b40f-fb93-49c2-95a3-f3990a4bf228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:13.056843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481b40f-fb93-49c2-95a3-f3990a4bf228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:13.057446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481b40f-fb93-49c2-95a3-f3990a4bf228 admin admin] PATH_INFO: `/v3/projects/1bce07b4b3cf4ff69aed492af635495c/users/8740d2bd12094afca7e1e04a32276e9f/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:13.064616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481b40f-fb93-49c2-95a3-f3990a4bf228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bce07b4b3cf4ff69aed492af635495c, user_id=8740d2bd12094afca7e1e04a32276e9f, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:13.067608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481b40f-fb93-49c2-95a3-f3990a4bf228 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:13.082191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 984/1973] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:13 2022] PUT /identity/v3/projects/1bce07b4b3cf4ff69aed492af635495c/users/8740d2bd12094afca7e1e04a32276e9f/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:13.092844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f710ae6-fe8e-4d7d-b3be-f581aac6087e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:13.093157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f710ae6-fe8e-4d7d-b3be-f581aac6087e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:13.093458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f710ae6-fe8e-4d7d-b3be-f581aac6087e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:13.129657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7f710ae6-fe8e-4d7d-b3be-f581aac6087e None None] MFA Rules not processed for user `8740d2bd12094afca7e1e04a32276e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:13.130948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7f710ae6-fe8e-4d7d-b3be-f581aac6087e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:13.226079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 990/1974] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:13.239538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481b40f-fb93-49c2-95a3-f3990a4bf228 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:13.241670 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5481b40f-fb93-49c2-95a3-f3990a4bf228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:13.376169 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481b40f-fb93-49c2-95a3-f3990a4bf228 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:13.380398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e537d-40d0-49db-b5ea-858da5e95c45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:13.381682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e537d-40d0-49db-b5ea-858da5e95c45 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:13.381961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e537d-40d0-49db-b5ea-858da5e95c45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:13.382236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e537d-40d0-49db-b5ea-858da5e95c45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:13.393476 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e537d-40d0-49db-b5ea-858da5e95c45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:13.395574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e537d-40d0-49db-b5ea-858da5e95c45 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:13.411052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 985/1975] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:13.943706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f710ae6-fe8e-4d7d-b3be-f581aac6087e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:13.956124 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f710ae6-fe8e-4d7d-b3be-f581aac6087e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:13.961135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb0a5-1d9b-4e66-ad77-84e63ae1bcd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:13.962338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb0a5-1d9b-4e66-ad77-84e63ae1bcd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:13.962338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb0a5-1d9b-4e66-ad77-84e63ae1bcd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:13.962649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb0a5-1d9b-4e66-ad77-84e63ae1bcd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:13.981382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:14.037096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fb0a5-1d9b-4e66-ad77-84e63ae1bcd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:14.038776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fb0a5-1d9b-4e66-ad77-84e63ae1bcd4 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:14.064205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 991/1976] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:14.171634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e537d-40d0-49db-b5ea-858da5e95c45 service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:14.173531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5f5e537d-40d0-49db-b5ea-858da5e95c45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:14.218439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb0a5-1d9b-4e66-ad77-84e63ae1bcd4 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:14.229188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb0a5-1d9b-4e66-ad77-84e63ae1bcd4 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:14.236867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454659a-178c-4696-b277-da12f368778f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:14.237995 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454659a-178c-4696-b277-da12f368778f service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:14.239024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454659a-178c-4696-b277-da12f368778f service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:14.239588 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454659a-178c-4696-b277-da12f368778f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:14.243217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b454659a-178c-4696-b277-da12f368778f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:14.270869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:14.304061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e537d-40d0-49db-b5ea-858da5e95c45 service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:14.311234 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:14.318014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:14.318507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:14.319009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] PATH_INFO: `/v3/users/f8c4406e680f4d8db54d3bfc874517fd` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:14.320741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c4406e680f4d8db54d3bfc874517fd)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:14.323848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:14.362665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454659a-178c-4696-b277-da12f368778f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:14.364025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454659a-178c-4696-b277-da12f368778f service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:14.375906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 992/1977] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:14.407027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c4406e680f4d8db54d3bfc874517fd'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:14.407916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c4406e680f4d8db54d3bfc874517fd'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:14.417263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c4406e680f4d8db54d3bfc874517fd'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:14.434907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c4406e680f4d8db54d3bfc874517fd'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:14.457918 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c4406e680f4d8db54d3bfc874517fd'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:14.465413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 986/1978] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:14 2022] DELETE /identity/v3/users/f8c4406e680f4d8db54d3bfc874517fd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:14.470115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaa304-3cb6-4a09-9b2d-32df587758ba None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:14.470532 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaa304-3cb6-4a09-9b2d-32df587758ba None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:14.470838 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaa304-3cb6-4a09-9b2d-32df587758ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:14.504111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-57aaa304-3cb6-4a09-9b2d-32df587758ba None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:14.505889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-57aaa304-3cb6-4a09-9b2d-32df587758ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:14.569087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 993/1979] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:14.580004 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:14.582359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:14.659667 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590395be-ca4a-421d-bd88-e7905d9757e0 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:14.663617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e3e2a-14f6-4dea-a934-f6b63993761c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:14.664289 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3e2a-14f6-4dea-a934-f6b63993761c service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:14.664568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3e2a-14f6-4dea-a934-f6b63993761c service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:14.664838 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3e2a-14f6-4dea-a934-f6b63993761c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:14.680163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e3e2a-14f6-4dea-a934-f6b63993761c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:14.682021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e3e2a-14f6-4dea-a934-f6b63993761c service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:14.706103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 987/1980] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:14.721335 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aaa304-3cb6-4a09-9b2d-32df587758ba None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:14.723337 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-57aaa304-3cb6-4a09-9b2d-32df587758ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:14.738444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aaa304-3cb6-4a09-9b2d-32df587758ba None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:14.747654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:14.749335 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:14.749753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:14.750213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] PATH_INFO: `/v3/users/adca47c80f144b6d9c54969feb7a0539` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:14.754047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=adca47c80f144b6d9c54969feb7a0539)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:14.761316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:14.844906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:14.847398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adca47c80f144b6d9c54969feb7a0539'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:14.848680 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adca47c80f144b6d9c54969feb7a0539'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:14.861715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adca47c80f144b6d9c54969feb7a0539'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:14.879665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adca47c80f144b6d9c54969feb7a0539'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:14.890112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adca47c80f144b6d9c54969feb7a0539'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:14.899388 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 994/1981] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:14 2022] DELETE /identity/v3/users/adca47c80f144b6d9c54969feb7a0539 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:14.904437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729722-febc-4ed7-b8c0-829cc2e4a272 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:14.904722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729722-febc-4ed7-b8c0-829cc2e4a272 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:14.904990 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729722-febc-4ed7-b8c0-829cc2e4a272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:14.922861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-64729722-febc-4ed7-b8c0-829cc2e4a272 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:14.924057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-64729722-febc-4ed7-b8c0-829cc2e4a272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:14.989321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 988/1982] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:14.999250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:15.001991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:15.068542 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09745aee-1c96-4863-b54b-b77bbcdc7b7f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:15.074121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992a2e0-9e65-4336-b8f9-d6029ed7d15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:15.074856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992a2e0-9e65-4336-b8f9-d6029ed7d15f service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:15.075138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992a2e0-9e65-4336-b8f9-d6029ed7d15f service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:15.075402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992a2e0-9e65-4336-b8f9-d6029ed7d15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:15.085155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64729722-febc-4ed7-b8c0-829cc2e4a272 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:15.086244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992a2e0-9e65-4336-b8f9-d6029ed7d15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:15.086690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-64729722-febc-4ed7-b8c0-829cc2e4a272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:15.087840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992a2e0-9e65-4336-b8f9-d6029ed7d15f service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:15.099089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64729722-febc-4ed7-b8c0-829cc2e4a272 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:15.100359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 995/1983] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:15.105982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:15.106443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:15.106799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:15.107140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] PATH_INFO: `/v3/projects/72525967a2d940beb1254f563fbaf940` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:15.108743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72525967a2d940beb1254f563fbaf940)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:15.111371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:15.119368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:15.239774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72525967a2d940beb1254f563fbaf940', 'request_id': 'req-458d7377-c221-46eb-ad86-726e35ff08d7'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.259288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72525967a2d940beb1254f563fbaf940', 'request_id': 'req-458d7377-c221-46eb-ad86-726e35ff08d7'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.278396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72525967a2d940beb1254f563fbaf940', 'request_id': 'req-458d7377-c221-46eb-ad86-726e35ff08d7'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.297620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] The token cache is being invalidate because project 72525967a2d940beb1254f563fbaf940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:15.297620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.297922 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.299672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 989/1984] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:15 2022] DELETE /identity/v3/projects/72525967a2d940beb1254f563fbaf940 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:15.305376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992a2e0-9e65-4336-b8f9-d6029ed7d15f service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:15.320101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992a2e0-9e65-4336-b8f9-d6029ed7d15f service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:15.380709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:15.381632 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:15.381906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:15.382173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] PATH_INFO: `/v3/users/8a470be95dce4145a80a624e612cd80e` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:15.383386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a470be95dce4145a80a624e612cd80e)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:15.385400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:15.438150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a470be95dce4145a80a624e612cd80e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.439356 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a470be95dce4145a80a624e612cd80e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.450060 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a470be95dce4145a80a624e612cd80e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.462713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:15.463258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:15.464497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a470be95dce4145a80a624e612cd80e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.465112 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:15.480602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a470be95dce4145a80a624e612cd80e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.481637 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d7377-c221-46eb-ad86-726e35ff08d7 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:15.487805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 996/1985] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:15 2022] DELETE /identity/v3/users/8a470be95dce4145a80a624e612cd80e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:15.487954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:15.490980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:15.490980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:15.490980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] PATH_INFO: `/v3/projects/7294a26c10514490a294a7cecbe343d3` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:15.499170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7294a26c10514490a294a7cecbe343d3)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:15.501381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:15.573821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7294a26c10514490a294a7cecbe343d3', 'request_id': 'req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.580789 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7294a26c10514490a294a7cecbe343d3', 'request_id': 'req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.598334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7294a26c10514490a294a7cecbe343d3', 'request_id': 'req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.616636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] The token cache is being invalidate because project 7294a26c10514490a294a7cecbe343d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:15.616936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.618512 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.621581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 990/1986] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:15 2022] DELETE /identity/v3/projects/7294a26c10514490a294a7cecbe343d3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:15.624840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:15.628466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:15.730754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c8b6-c976-460e-b1ee-1dd9b54f8c56 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:15.814274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24524b4e-1976-420f-b8c1-b66f4c684272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:15.815782 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24524b4e-1976-420f-b8c1-b66f4c684272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:15.816231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24524b4e-1976-420f-b8c1-b66f4c684272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:15.816669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24524b4e-1976-420f-b8c1-b66f4c684272 admin admin] PATH_INFO: `/v3/users/8740d2bd12094afca7e1e04a32276e9f` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:15.818786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24524b4e-1976-420f-b8c1-b66f4c684272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8740d2bd12094afca7e1e04a32276e9f)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:15.822455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24524b4e-1976-420f-b8c1-b66f4c684272 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:15.872766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:15.875261 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:15.904661 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3c6df-78e3-42ca-9d36-f16304ef8c3b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:15.921381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:15.925227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:15.926501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:15.927373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] PATH_INFO: `/v3/projects/8b012e7a20b14ff4ab252b20459de29d` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:15.932010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b012e7a20b14ff4ab252b20459de29d)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:15.941972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:15.959681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-24524b4e-1976-420f-b8c1-b66f4c684272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8740d2bd12094afca7e1e04a32276e9f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:15.961000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-24524b4e-1976-420f-b8c1-b66f4c684272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8740d2bd12094afca7e1e04a32276e9f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.007369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-24524b4e-1976-420f-b8c1-b66f4c684272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8740d2bd12094afca7e1e04a32276e9f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.033865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-24524b4e-1976-420f-b8c1-b66f4c684272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8740d2bd12094afca7e1e04a32276e9f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.040297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b012e7a20b14ff4ab252b20459de29d', 'request_id': 'req-9d773532-87bb-486d-ae3b-525b750177b1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.044906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-24524b4e-1976-420f-b8c1-b66f4c684272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8740d2bd12094afca7e1e04a32276e9f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.057342 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 997/1987] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:15 2022] DELETE /identity/v3/users/8740d2bd12094afca7e1e04a32276e9f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:16.063700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b012e7a20b14ff4ab252b20459de29d', 'request_id': 'req-9d773532-87bb-486d-ae3b-525b750177b1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.076869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b012e7a20b14ff4ab252b20459de29d', 'request_id': 'req-9d773532-87bb-486d-ae3b-525b750177b1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.088704 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:16.100000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] The token cache is being invalidate because project 8b012e7a20b14ff4ab252b20459de29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:16.100870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.101898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9d773532-87bb-486d-ae3b-525b750177b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.105176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 991/1988] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:15 2022] DELETE /identity/v3/projects/8b012e7a20b14ff4ab252b20459de29d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:16.112616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f63e3-8274-4635-a4db-6dbfcdf3557a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.112933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f63e3-8274-4635-a4db-6dbfcdf3557a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.113210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f63e3-8274-4635-a4db-6dbfcdf3557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.137628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3a7f63e3-8274-4635-a4db-6dbfcdf3557a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:16.138862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3a7f63e3-8274-4635-a4db-6dbfcdf3557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:16.145074 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:16.215567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 998/1989] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:16.226700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a0903-be41-4f5d-809e-23e52bcc1538 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.226902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a0903-be41-4f5d-809e-23e52bcc1538 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.227277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a0903-be41-4f5d-809e-23e52bcc1538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.254877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-459a0903-be41-4f5d-809e-23e52bcc1538 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:16.256138 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-459a0903-be41-4f5d-809e-23e52bcc1538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:16.265802 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 992/1990] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:16.269471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f63e3-8274-4635-a4db-6dbfcdf3557a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.279396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f63e3-8274-4635-a4db-6dbfcdf3557a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:16.285800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263cef1-e4cd-41ca-b68b-2a544ce20d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:16.286525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263cef1-e4cd-41ca-b68b-2a544ce20d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.286830 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263cef1-e4cd-41ca-b68b-2a544ce20d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.287111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263cef1-e4cd-41ca-b68b-2a544ce20d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.288029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263cef1-e4cd-41ca-b68b-2a544ce20d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:16.288332 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263cef1-e4cd-41ca-b68b-2a544ce20d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:16.289980 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263cef1-e4cd-41ca-b68b-2a544ce20d81 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:16.308211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 999/1991] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:18:16.309354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a0903-be41-4f5d-809e-23e52bcc1538 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.319401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a0903-be41-4f5d-809e-23e52bcc1538 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:16.324882 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4073f8d-8e6d-4fe4-bfa4-8b49cd2eb4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:16.325582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073f8d-8e6d-4fe4-bfa4-8b49cd2eb4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.325902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073f8d-8e6d-4fe4-bfa4-8b49cd2eb4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.326179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073f8d-8e6d-4fe4-bfa4-8b49cd2eb4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.327334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4073f8d-8e6d-4fe4-bfa4-8b49cd2eb4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:16.329020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4073f8d-8e6d-4fe4-bfa4-8b49cd2eb4a7 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:16.362727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 993/1992] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:16 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:16.368261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263cef1-e4cd-41ca-b68b-2a544ce20d81 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.380461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263cef1-e4cd-41ca-b68b-2a544ce20d81 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:16.407245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4073f8d-8e6d-4fe4-bfa4-8b49cd2eb4a7 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.409767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f4073f8d-8e6d-4fe4-bfa4-8b49cd2eb4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:16.463014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d271e05-7a46-48b8-b8c2-acb83d995b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:16.463935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d271e05-7a46-48b8-b8c2-acb83d995b10 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.464073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d271e05-7a46-48b8-b8c2-acb83d995b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.464646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d271e05-7a46-48b8-b8c2-acb83d995b10 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.465411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d271e05-7a46-48b8-b8c2-acb83d995b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:16.467501 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d271e05-7a46-48b8-b8c2-acb83d995b10 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:16.490471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1000/1993] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:16 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:16.494533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d271e05-7a46-48b8-b8c2-acb83d995b10 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.507604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d271e05-7a46-48b8-b8c2-acb83d995b10 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:16.512308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0299d7-e5e4-4aea-b86e-6c6300999256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:16.512989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0299d7-e5e4-4aea-b86e-6c6300999256 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.513270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0299d7-e5e4-4aea-b86e-6c6300999256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.513608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0299d7-e5e4-4aea-b86e-6c6300999256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.514376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0299d7-e5e4-4aea-b86e-6c6300999256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:16.516170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0299d7-e5e4-4aea-b86e-6c6300999256 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:16.522958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4073f8d-8e6d-4fe4-bfa4-8b49cd2eb4a7 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:16.527986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1001/1994] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:16.528652 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:16.529556 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.529833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.530100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] PATH_INFO: `/v3/projects/1bce07b4b3cf4ff69aed492af635495c` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.531450 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bce07b4b3cf4ff69aed492af635495c)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:16.533139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0299d7-e5e4-4aea-b86e-6c6300999256 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.534969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:16.544850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0299d7-e5e4-4aea-b86e-6c6300999256 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:16.551012 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c8fad-882e-44f9-bd57-e69172d02eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:16.551950 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8fad-882e-44f9-bd57-e69172d02eee admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.552324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8fad-882e-44f9-bd57-e69172d02eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.552681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8fad-882e-44f9-bd57-e69172d02eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.553484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c8fad-882e-44f9-bd57-e69172d02eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:16.555192 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c8fad-882e-44f9-bd57-e69172d02eee admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:16.571288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1002/1995] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:16.576373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c8fad-882e-44f9-bd57-e69172d02eee admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.590271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c8fad-882e-44f9-bd57-e69172d02eee admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:16.594695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bce07b4b3cf4ff69aed492af635495c', 'request_id': 'req-ab56f1f5-694e-4486-99b3-c630b2524ae9'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.601482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bce07b4b3cf4ff69aed492af635495c', 'request_id': 'req-ab56f1f5-694e-4486-99b3-c630b2524ae9'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.611391 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bce07b4b3cf4ff69aed492af635495c', 'request_id': 'req-ab56f1f5-694e-4486-99b3-c630b2524ae9'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.624647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] The token cache is being invalidate because project 1bce07b4b3cf4ff69aed492af635495c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:16.624942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.625775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ab56f1f5-694e-4486-99b3-c630b2524ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:16.627460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 994/1996] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:16 2022] DELETE /identity/v3/projects/1bce07b4b3cf4ff69aed492af635495c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:16.632368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf238fb1-3f39-4d40-831b-cd67028011a2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.632737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf238fb1-3f39-4d40-831b-cd67028011a2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.633082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf238fb1-3f39-4d40-831b-cd67028011a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.651806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-bf238fb1-3f39-4d40-831b-cd67028011a2 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:16.653135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bf238fb1-3f39-4d40-831b-cd67028011a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:16.656140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063557f-c91a-4352-a013-8f7a2f67718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:16.657420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063557f-c91a-4352-a013-8f7a2f67718d admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.657770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063557f-c91a-4352-a013-8f7a2f67718d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.658109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063557f-c91a-4352-a013-8f7a2f67718d admin admin] PATH_INFO: `/v3/projects/e172ec7efcc04b7c98f492c4235a45c5/users/6943c04f52c24b42bba9c85b6190271b/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.662643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 995/1997] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:16.670833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:16.671799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac14ee4-aa56-423f-a5b2-a1414da17e61 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.671799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac14ee4-aa56-423f-a5b2-a1414da17e61 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.672561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac14ee4-aa56-423f-a5b2-a1414da17e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.686059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063557f-c91a-4352-a013-8f7a2f67718d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e172ec7efcc04b7c98f492c4235a45c5, user_id=6943c04f52c24b42bba9c85b6190271b, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:16.689073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063557f-c91a-4352-a013-8f7a2f67718d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:16.700596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8ac14ee4-aa56-423f-a5b2-a1414da17e61 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:16.701888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8ac14ee4-aa56-423f-a5b2-a1414da17e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:16.706698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1003/1998] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:16 2022] PUT /identity/v3/projects/e172ec7efcc04b7c98f492c4235a45c5/users/6943c04f52c24b42bba9c85b6190271b/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:16.718512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ee019-bff2-4618-a6d3-e2c20a255578 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.718872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ee019-bff2-4618-a6d3-e2c20a255578 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.719262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ee019-bff2-4618-a6d3-e2c20a255578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.758270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-470ee019-bff2-4618-a6d3-e2c20a255578 None None] MFA Rules not processed for user `6943c04f52c24b42bba9c85b6190271b`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:16.760077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-470ee019-bff2-4618-a6d3-e2c20a255578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:16.762578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:16.786504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 996/1999] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:16.787776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac14ee4-aa56-423f-a5b2-a1414da17e61 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.801267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac14ee4-aa56-423f-a5b2-a1414da17e61 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:16.808686 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b973e-9ed3-4358-a06a-0cb45bc7542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:16.809964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b973e-9ed3-4358-a06a-0cb45bc7542d admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.811008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b973e-9ed3-4358-a06a-0cb45bc7542d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.811672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b973e-9ed3-4358-a06a-0cb45bc7542d admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.812806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b973e-9ed3-4358-a06a-0cb45bc7542d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:16.814194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b973e-9ed3-4358-a06a-0cb45bc7542d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:16.817110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b973e-9ed3-4358-a06a-0cb45bc7542d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:16.831612 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 997/2000] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:18:16.836727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b973e-9ed3-4358-a06a-0cb45bc7542d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.850875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b973e-9ed3-4358-a06a-0cb45bc7542d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:16.859165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485633a6-601a-4104-a178-5843c99b7cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:16.859880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485633a6-601a-4104-a178-5843c99b7cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.860349 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485633a6-601a-4104-a178-5843c99b7cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.860896 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1004/2001] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:16.861204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485633a6-601a-4104-a178-5843c99b7cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.861887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485633a6-601a-4104-a178-5843c99b7cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:16.863912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485633a6-601a-4104-a178-5843c99b7cb4 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:16.864927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ee019-bff2-4618-a6d3-e2c20a255578 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.866408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-470ee019-bff2-4618-a6d3-e2c20a255578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:16.881156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ee019-bff2-4618-a6d3-e2c20a255578 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:16.888517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80224150-a0ea-4206-9c39-10df7f60b528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:16.889204 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80224150-a0ea-4206-9c39-10df7f60b528 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:16.889480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80224150-a0ea-4206-9c39-10df7f60b528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:16.889763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80224150-a0ea-4206-9c39-10df7f60b528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:16.890485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80224150-a0ea-4206-9c39-10df7f60b528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:16.892733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80224150-a0ea-4206-9c39-10df7f60b528 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:16.898763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 998/2002] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:16 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:16.900177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485633a6-601a-4104-a178-5843c99b7cb4 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.929288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1005/2003] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:16 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:16.933712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80224150-a0ea-4206-9c39-10df7f60b528 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:16.993509 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485633a6-601a-4104-a178-5843c99b7cb4 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:17.029815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80224150-a0ea-4206-9c39-10df7f60b528 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:17.037984 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e18ce3-9ab6-451f-9f5c-7881fbb8d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:17.038745 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18ce3-9ab6-451f-9f5c-7881fbb8d231 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.039187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18ce3-9ab6-451f-9f5c-7881fbb8d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.039755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18ce3-9ab6-451f-9f5c-7881fbb8d231 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.040684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e18ce3-9ab6-451f-9f5c-7881fbb8d231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:17.053093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e18ce3-9ab6-451f-9f5c-7881fbb8d231 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:17.076551 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a77236-adfd-47ba-9c9d-626acc874c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:17.077343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a77236-adfd-47ba-9c9d-626acc874c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.077664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a77236-adfd-47ba-9c9d-626acc874c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.077941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a77236-adfd-47ba-9c9d-626acc874c27 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.079169 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a77236-adfd-47ba-9c9d-626acc874c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:17.081614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a77236-adfd-47ba-9c9d-626acc874c27 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:17.089546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1006/2004] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:16 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:17.094736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e18ce3-9ab6-451f-9f5c-7881fbb8d231 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:17.109245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e18ce3-9ab6-451f-9f5c-7881fbb8d231 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:17.114598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c769188-0fa2-46d1-b0a7-cade09608c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:17.115352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c769188-0fa2-46d1-b0a7-cade09608c7a admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.115691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c769188-0fa2-46d1-b0a7-cade09608c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.116021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c769188-0fa2-46d1-b0a7-cade09608c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.116954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c769188-0fa2-46d1-b0a7-cade09608c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:17.118667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c769188-0fa2-46d1-b0a7-cade09608c7a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:17.120434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 999/2005] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:16 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:17.125018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a77236-adfd-47ba-9c9d-626acc874c27 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:17.139259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a77236-adfd-47ba-9c9d-626acc874c27 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:17.139675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1007/2006] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:17.140553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c769188-0fa2-46d1-b0a7-cade09608c7a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:17.144246 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c754ca-9841-4011-9f1f-2177b4c250ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:17.144986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c754ca-9841-4011-9f1f-2177b4c250ca admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.145274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c754ca-9841-4011-9f1f-2177b4c250ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.145548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c754ca-9841-4011-9f1f-2177b4c250ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.146316 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c754ca-9841-4011-9f1f-2177b4c250ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:17.148097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c754ca-9841-4011-9f1f-2177b4c250ca admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:17.152127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c769188-0fa2-46d1-b0a7-cade09608c7a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:17.159467 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f21015-0f87-4614-b89f-7f6d5c3e105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:17.161132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f21015-0f87-4614-b89f-7f6d5c3e105f admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.161586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f21015-0f87-4614-b89f-7f6d5c3e105f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.161995 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f21015-0f87-4614-b89f-7f6d5c3e105f admin admin] PATH_INFO: `/v3/projects/bc295d2976dc49789ec2ff14ff6623f2/users/73d4df045c5743088b85e1374118d45c/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.170433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1000/2007] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:17.171930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c754ca-9841-4011-9f1f-2177b4c250ca admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:17.187952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c754ca-9841-4011-9f1f-2177b4c250ca admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:17.193335 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f21015-0f87-4614-b89f-7f6d5c3e105f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc295d2976dc49789ec2ff14ff6623f2, user_id=73d4df045c5743088b85e1374118d45c, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:17.196093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f21015-0f87-4614-b89f-7f6d5c3e105f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:17.205172 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78722afe-f86f-43fd-ad50-a887bcb372f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:17.205871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78722afe-f86f-43fd-ad50-a887bcb372f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.206235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78722afe-f86f-43fd-ad50-a887bcb372f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.206589 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78722afe-f86f-43fd-ad50-a887bcb372f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.207662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78722afe-f86f-43fd-ad50-a887bcb372f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:17.209275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78722afe-f86f-43fd-ad50-a887bcb372f0 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:17.219834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1008/2008] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:17 2022] PUT /identity/v3/projects/bc295d2976dc49789ec2ff14ff6623f2/users/73d4df045c5743088b85e1374118d45c/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:17.224087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1001/2009] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:17.225614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f21015-0f87-4614-b89f-7f6d5c3e105f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:17.229451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78722afe-f86f-43fd-ad50-a887bcb372f0 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:17.243146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78722afe-f86f-43fd-ad50-a887bcb372f0 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:17.249223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:17.284612 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:17.321894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c4083-2725-40ae-a45f-022971930e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:17.324650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c4083-2725-40ae-a45f-022971930e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.325553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c4083-2725-40ae-a45f-022971930e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.326579 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c4083-2725-40ae-a45f-022971930e0b admin admin] PATH_INFO: `/v3/projects/10701fb4212e40ec9231cd2803983cee/users/e476fa46e893493bae01468dc57ccb12/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.351202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c4083-2725-40ae-a45f-022971930e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10701fb4212e40ec9231cd2803983cee, user_id=e476fa46e893493bae01468dc57ccb12, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:17.358221 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c4083-2725-40ae-a45f-022971930e0b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:17.363064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f21015-0f87-4614-b89f-7f6d5c3e105f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:17.369904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aedd6-ee6f-4c8e-986c-1ad0e0b1d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:17.371093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aedd6-ee6f-4c8e-986c-1ad0e0b1d432 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.371380 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aedd6-ee6f-4c8e-986c-1ad0e0b1d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.371697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aedd6-ee6f-4c8e-986c-1ad0e0b1d432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.372753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aedd6-ee6f-4c8e-986c-1ad0e0b1d432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:17.376791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aedd6-ee6f-4c8e-986c-1ad0e0b1d432 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:17.380536 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1002/2010] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:17 2022] PUT /identity/v3/projects/10701fb4212e40ec9231cd2803983cee/users/e476fa46e893493bae01468dc57ccb12/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:17.383387 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060956a-d6ad-4bbc-ba35-648e422b9dd9 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.383855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060956a-d6ad-4bbc-ba35-648e422b9dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.384272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060956a-d6ad-4bbc-ba35-648e422b9dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.392876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1009/2011] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:17.396748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aedd6-ee6f-4c8e-986c-1ad0e0b1d432 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:17.414127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7060956a-d6ad-4bbc-ba35-648e422b9dd9 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:17.416146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7060956a-d6ad-4bbc-ba35-648e422b9dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:17.425685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aedd6-ee6f-4c8e-986c-1ad0e0b1d432 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:17.512762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654b558-3253-4ec5-8595-d1330b122e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:17.514027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b558-3253-4ec5-8595-d1330b122e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.514554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b558-3253-4ec5-8595-d1330b122e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.515655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b558-3253-4ec5-8595-d1330b122e0f admin admin] PATH_INFO: `/v3/projects/bc295d2976dc49789ec2ff14ff6623f2/users/73d4df045c5743088b85e1374118d45c/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.520381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654b558-3253-4ec5-8595-d1330b122e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc295d2976dc49789ec2ff14ff6623f2, user_id=73d4df045c5743088b85e1374118d45c, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:17.523921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654b558-3253-4ec5-8595-d1330b122e0f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:17.550751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1003/2012] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:17.560778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1010/2013] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:17 2022] PUT /identity/v3/projects/bc295d2976dc49789ec2ff14ff6623f2/users/73d4df045c5743088b85e1374118d45c/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:17.563458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a85b0-3c19-4069-9eb2-4f36ad1f8a22 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.563752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a85b0-3c19-4069-9eb2-4f36ad1f8a22 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.564053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a85b0-3c19-4069-9eb2-4f36ad1f8a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.565474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654b558-3253-4ec5-8595-d1330b122e0f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:17.568729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4654b558-3253-4ec5-8595-d1330b122e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:17.604313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-d06a85b0-3c19-4069-9eb2-4f36ad1f8a22 None None] MFA Rules not processed for user `73d4df045c5743088b85e1374118d45c`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:17.605784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d06a85b0-3c19-4069-9eb2-4f36ad1f8a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:17.649645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654b558-3253-4ec5-8595-d1330b122e0f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:17.658769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b9e13-7b73-4274-8060-3e278d97d145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:17.659736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b9e13-7b73-4274-8060-3e278d97d145 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.660159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b9e13-7b73-4274-8060-3e278d97d145 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.660859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b9e13-7b73-4274-8060-3e278d97d145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.698853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1004/2014] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:17.712049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a85b0-3c19-4069-9eb2-4f36ad1f8a22 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:17.715812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d06a85b0-3c19-4069-9eb2-4f36ad1f8a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:17.746084 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:17.778004 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b9e13-7b73-4274-8060-3e278d97d145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:17.780434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b9e13-7b73-4274-8060-3e278d97d145 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:17.794861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:17.799482 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1011/2015] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:17.812846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a85b0-3c19-4069-9eb2-4f36ad1f8a22 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:17.817696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40fac4-389f-43ab-bd1f-f9f251b27a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:17.818565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40fac4-389f-43ab-bd1f-f9f251b27a7d service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:17.819277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40fac4-389f-43ab-bd1f-f9f251b27a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:17.819561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40fac4-389f-43ab-bd1f-f9f251b27a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:17.832132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40fac4-389f-43ab-bd1f-f9f251b27a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:17.834127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40fac4-389f-43ab-bd1f-f9f251b27a7d service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:17.854922 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1005/2016] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:18.020477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b9e13-7b73-4274-8060-3e278d97d145 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:18.022194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f86b9e13-7b73-4274-8060-3e278d97d145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:18.035813 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b9e13-7b73-4274-8060-3e278d97d145 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:18.054089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:18.055051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:18.055331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:18.055604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] PATH_INFO: `/v3/users/3cbf81d344314961bbf76cc03f10bd22` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:18.057606 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbf81d344314961bbf76cc03f10bd22)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:18.060072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:18.170108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbf81d344314961bbf76cc03f10bd22'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:18.171306 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbf81d344314961bbf76cc03f10bd22'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:18.206414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbf81d344314961bbf76cc03f10bd22'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:18.233742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbf81d344314961bbf76cc03f10bd22'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:18.255005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbf81d344314961bbf76cc03f10bd22'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:18.273339 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1012/2017] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:18 2022] DELETE /identity/v3/users/3cbf81d344314961bbf76cc03f10bd22 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:18.281957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f8d6d-de70-4629-b051-ad291798eb85 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:18.281957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f8d6d-de70-4629-b051-ad291798eb85 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:18.282224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f8d6d-de70-4629-b051-ad291798eb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:18.361316 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7e0f8d6d-de70-4629-b051-ad291798eb85 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:18.366176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7e0f8d6d-de70-4629-b051-ad291798eb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:18.506170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1006/2018] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:18.516616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:18.518817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:18.655861 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf2937-4ce8-4cd3-8b3e-5b03528e92b7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:18.661346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae026a4d-8753-4a49-ba76-2e67f4a42d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:18.662030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae026a4d-8753-4a49-ba76-2e67f4a42d09 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:18.662333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae026a4d-8753-4a49-ba76-2e67f4a42d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:18.662614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae026a4d-8753-4a49-ba76-2e67f4a42d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:18.674500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae026a4d-8753-4a49-ba76-2e67f4a42d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:18.676561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae026a4d-8753-4a49-ba76-2e67f4a42d09 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:18.689269 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1013/2019] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:18.772484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f8d6d-de70-4629-b051-ad291798eb85 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:18.775090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7e0f8d6d-de70-4629-b051-ad291798eb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:18.794372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f8d6d-de70-4629-b051-ad291798eb85 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:18.805628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:18.809455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:18.810016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:18.810261 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] PATH_INFO: `/v3/users/eb743949c29c42879604a519593f56f9` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:18.814593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb743949c29c42879604a519593f56f9)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:18.819679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:18.936722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb743949c29c42879604a519593f56f9'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:18.938472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb743949c29c42879604a519593f56f9'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:18.958833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb743949c29c42879604a519593f56f9'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:18.976416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb743949c29c42879604a519593f56f9'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.006687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb743949c29c42879604a519593f56f9'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.026989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1007/2020] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:18 2022] DELETE /identity/v3/users/eb743949c29c42879604a519593f56f9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:19.031968 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f2e49-d17e-4317-8a00-c3259f9db044 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:19.032341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f2e49-d17e-4317-8a00-c3259f9db044 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:19.033077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f2e49-d17e-4317-8a00-c3259f9db044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:19.071549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-505f2e49-d17e-4317-8a00-c3259f9db044 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:19.072790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-505f2e49-d17e-4317-8a00-c3259f9db044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:19.118908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:19.120640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:19.233094 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1014/2021] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:19.245915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f2e49-d17e-4317-8a00-c3259f9db044 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:19.247462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-505f2e49-d17e-4317-8a00-c3259f9db044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:19.249878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06615dea-dadb-415b-b9fc-4b2f08d81c05 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:19.258726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd1cd4-071d-44ef-bf8d-37d228fa1edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:19.260777 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1cd4-071d-44ef-bf8d-37d228fa1edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:19.261705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1cd4-071d-44ef-bf8d-37d228fa1edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:19.262087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:19.262582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1cd4-071d-44ef-bf8d-37d228fa1edd admin admin] PATH_INFO: `/v3/users/6943c04f52c24b42bba9c85b6190271b` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:19.264306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd1cd4-071d-44ef-bf8d-37d228fa1edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6943c04f52c24b42bba9c85b6190271b)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:19.266988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd1cd4-071d-44ef-bf8d-37d228fa1edd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:19.269893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:19.362484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e4fd1cd4-071d-44ef-bf8d-37d228fa1edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6943c04f52c24b42bba9c85b6190271b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.364120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e4fd1cd4-071d-44ef-bf8d-37d228fa1edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6943c04f52c24b42bba9c85b6190271b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.373849 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e4fd1cd4-071d-44ef-bf8d-37d228fa1edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6943c04f52c24b42bba9c85b6190271b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.385084 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f2e49-d17e-4317-8a00-c3259f9db044 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:19.388929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e4fd1cd4-071d-44ef-bf8d-37d228fa1edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6943c04f52c24b42bba9c85b6190271b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.392494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda743-798b-4c14-a278-4ee7c758bce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:19.393211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda743-798b-4c14-a278-4ee7c758bce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:19.393973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda743-798b-4c14-a278-4ee7c758bce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:19.394242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda743-798b-4c14-a278-4ee7c758bce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:19.406504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e4fd1cd4-071d-44ef-bf8d-37d228fa1edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6943c04f52c24b42bba9c85b6190271b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.418800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda743-798b-4c14-a278-4ee7c758bce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:19.423112 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1008/2022] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:19 2022] DELETE /identity/v3/users/6943c04f52c24b42bba9c85b6190271b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:19.423271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda743-798b-4c14-a278-4ee7c758bce9 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:19.424640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a82d6f-67d6-49d5-b0b1-1b418ffb669a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:19.424924 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a82d6f-67d6-49d5-b0b1-1b418ffb669a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:19.425194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a82d6f-67d6-49d5-b0b1-1b418ffb669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:19.447203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1015/2023] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:18:19.448702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624028b7-8a1c-41ee-a4ab-43c4c0cb955a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:19.448871 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624028b7-8a1c-41ee-a4ab-43c4c0cb955a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:19.449160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624028b7-8a1c-41ee-a4ab-43c4c0cb955a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:19.474704 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-a7a82d6f-67d6-49d5-b0b1-1b418ffb669a None None] MFA Rules not processed for user `e476fa46e893493bae01468dc57ccb12`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:19.475942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a7a82d6f-67d6-49d5-b0b1-1b418ffb669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:19.497216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-624028b7-8a1c-41ee-a4ab-43c4c0cb955a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:19.501755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-624028b7-8a1c-41ee-a4ab-43c4c0cb955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:19.603547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1009/2024] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:19.610539 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a82d6f-67d6-49d5-b0b1-1b418ffb669a None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:19.611538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a7a82d6f-67d6-49d5-b0b1-1b418ffb669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:19.705053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a82d6f-67d6-49d5-b0b1-1b418ffb669a None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:19.712188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce1c1-eee9-4832-8528-4410513ddcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:19.712892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce1c1-eee9-4832-8528-4410513ddcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:19.713173 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce1c1-eee9-4832-8528-4410513ddcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:19.716534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce1c1-eee9-4832-8528-4410513ddcf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:19.716741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1016/2025] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:19.716843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ce1c1-eee9-4832-8528-4410513ddcf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:19.716946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624028b7-8a1c-41ee-a4ab-43c4c0cb955a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:19.717035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ce1c1-eee9-4832-8528-4410513ddcf7 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:19.720892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-624028b7-8a1c-41ee-a4ab-43c4c0cb955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:19.737334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:19.742192 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624028b7-8a1c-41ee-a4ab-43c4c0cb955a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:19.749182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:19.750098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:19.750455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:19.750923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] PATH_INFO: `/v3/projects/6e0e0cb5f1204ae39afeda841307a983` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:19.753011 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0e0cb5f1204ae39afeda841307a983)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:19.755147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:19.765966 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1010/2026] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:19 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:19.767467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce1c1-eee9-4832-8528-4410513ddcf7 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:19.769935 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-372ce1c1-eee9-4832-8528-4410513ddcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:19.891388 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0e0cb5f1204ae39afeda841307a983', 'request_id': 'req-0c23e286-40a6-44a7-b219-d6f41a2dc997'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.901765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce1c1-eee9-4832-8528-4410513ddcf7 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:19.903485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0e0cb5f1204ae39afeda841307a983', 'request_id': 'req-0c23e286-40a6-44a7-b219-d6f41a2dc997'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.916790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0e0cb5f1204ae39afeda841307a983', 'request_id': 'req-0c23e286-40a6-44a7-b219-d6f41a2dc997'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.949430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] The token cache is being invalidate because project 6e0e0cb5f1204ae39afeda841307a983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:19.949728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.956027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:19.960623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1017/2027] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:19 2022] DELETE /identity/v3/projects/6e0e0cb5f1204ae39afeda841307a983 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:19.960623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:19.960623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:19.971406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab890c90-d853-4b47-ae1b-7ea6b8e51f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:19.972082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab890c90-d853-4b47-ae1b-7ea6b8e51f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:19.972378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab890c90-d853-4b47-ae1b-7ea6b8e51f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:19.972645 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab890c90-d853-4b47-ae1b-7ea6b8e51f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:19.975272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ab890c90-d853-4b47-ae1b-7ea6b8e51f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:20.015852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:20.070987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23e286-40a6-44a7-b219-d6f41a2dc997 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:20.075904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac979db-9eb8-4293-ab1e-0e770dda316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:20.076754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac979db-9eb8-4293-ab1e-0e770dda316d admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:20.077043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac979db-9eb8-4293-ab1e-0e770dda316d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:20.077320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac979db-9eb8-4293-ab1e-0e770dda316d admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:20.078025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac979db-9eb8-4293-ab1e-0e770dda316d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:20.080106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac979db-9eb8-4293-ab1e-0e770dda316d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:20.083893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab890c90-d853-4b47-ae1b-7ea6b8e51f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:20.086019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab890c90-d853-4b47-ae1b-7ea6b8e51f68 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:20.107678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1018/2028] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:19 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:20.108677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac979db-9eb8-4293-ab1e-0e770dda316d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:20.111495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bac979db-9eb8-4293-ab1e-0e770dda316d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:20.115017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1011/2029] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:20.116238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab890c90-d853-4b47-ae1b-7ea6b8e51f68 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:20.117877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ab890c90-d853-4b47-ae1b-7ea6b8e51f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:20.125451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac979db-9eb8-4293-ab1e-0e770dda316d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:20.134246 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:20.135739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:20.137050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:20.137050 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] PATH_INFO: `/v3/users/2961a9fb592f48b18bc1a0fbb93781d8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:20.138432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab890c90-d853-4b47-ae1b-7ea6b8e51f68 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:20.140544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2961a9fb592f48b18bc1a0fbb93781d8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:20.144792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:20.153708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:20.155073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:20.155541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:20.155884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] PATH_INFO: `/v3/projects/edc1e38bc239427f834648a0ae8ea3e5` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:20.159011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc1e38bc239427f834648a0ae8ea3e5)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:20.162672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:20.229988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2961a9fb592f48b18bc1a0fbb93781d8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.230889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2961a9fb592f48b18bc1a0fbb93781d8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.240683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2961a9fb592f48b18bc1a0fbb93781d8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.248209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc1e38bc239427f834648a0ae8ea3e5', 'request_id': 'req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.259830 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2961a9fb592f48b18bc1a0fbb93781d8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.265132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc1e38bc239427f834648a0ae8ea3e5', 'request_id': 'req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.267190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:20.268938 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2961a9fb592f48b18bc1a0fbb93781d8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.277706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1019/2030] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:20 2022] DELETE /identity/v3/users/2961a9fb592f48b18bc1a0fbb93781d8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:20.278411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:20.280008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:20.281373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc1e38bc239427f834648a0ae8ea3e5', 'request_id': 'req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.296278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] The token cache is being invalidate because project edc1e38bc239427f834648a0ae8ea3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:20.296577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.297264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.299327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1012/2031] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:20 2022] DELETE /identity/v3/projects/edc1e38bc239427f834648a0ae8ea3e5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:20.302898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:20.304988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:20.367059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1d513-b171-4b5a-a2a1-a65f1b6ae729 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:20.374167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f70522-9b4a-47eb-9db9-2ac1da7fc1f3 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:20.381139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:20.382572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:20.383002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:20.383457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] PATH_INFO: `/v3/users/be1e467479084de7baba869726eaffbb` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:20.384712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdf153-57b9-48dd-8e85-7dbeb83c2d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:20.385110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1e467479084de7baba869726eaffbb)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:20.385693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdf153-57b9-48dd-8e85-7dbeb83c2d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:20.386065 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdf153-57b9-48dd-8e85-7dbeb83c2d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:20.386493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdf153-57b9-48dd-8e85-7dbeb83c2d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:20.387481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdf153-57b9-48dd-8e85-7dbeb83c2d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:20.388435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:20.391656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdf153-57b9-48dd-8e85-7dbeb83c2d99 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:20.411284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1020/2032] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:20.412133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdf153-57b9-48dd-8e85-7dbeb83c2d99 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:20.414882 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e5bdf153-57b9-48dd-8e85-7dbeb83c2d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:20.438261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdf153-57b9-48dd-8e85-7dbeb83c2d99 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:20.444891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad0b7f-9abd-4459-99b9-26884a2d0f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:20.446729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad0b7f-9abd-4459-99b9-26884a2d0f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:20.446729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad0b7f-9abd-4459-99b9-26884a2d0f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:20.446729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad0b7f-9abd-4459-99b9-26884a2d0f59 admin admin] PATH_INFO: `/v3/projects/62b54babccc748878a361398f6ca3461/users/d50a260b1f6d45fea8a0227228f6e34f/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:20.472764 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1e467479084de7baba869726eaffbb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.473511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1e467479084de7baba869726eaffbb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.476527 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad0b7f-9abd-4459-99b9-26884a2d0f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b54babccc748878a361398f6ca3461, user_id=d50a260b1f6d45fea8a0227228f6e34f, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:20.481291 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad0b7f-9abd-4459-99b9-26884a2d0f59 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:20.482911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1e467479084de7baba869726eaffbb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.493759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1e467479084de7baba869726eaffbb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.511088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1021/2033] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:20 2022] PUT /identity/v3/projects/62b54babccc748878a361398f6ca3461/users/d50a260b1f6d45fea8a0227228f6e34f/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:20.513309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad0b7f-9abd-4459-99b9-26884a2d0f59 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:20.522701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1e467479084de7baba869726eaffbb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.533858 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:20.534593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1013/2034] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:20 2022] DELETE /identity/v3/users/be1e467479084de7baba869726eaffbb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:20.627278 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad0b7f-9abd-4459-99b9-26884a2d0f59 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:20.646768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:20.648436 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:20.765348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1c49-935c-46c1-bff5-bf5deb0e902c admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:20.774133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:20.775380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:20.775820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:20.776359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] PATH_INFO: `/v3/projects/e172ec7efcc04b7c98f492c4235a45c5` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:20.777763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e172ec7efcc04b7c98f492c4235a45c5)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:20.780172 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:20.784113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:20.785734 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4e4eb-3b1f-4452-8f06-f2060bae822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:20.790009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4e4eb-3b1f-4452-8f06-f2060bae822c admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:20.790560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4e4eb-3b1f-4452-8f06-f2060bae822c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:20.790669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4e4eb-3b1f-4452-8f06-f2060bae822c admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:20.791372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4e4eb-3b1f-4452-8f06-f2060bae822c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:20.793095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4e4eb-3b1f-4452-8f06-f2060bae822c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:20.824242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1022/2035] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:20.825785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4e4eb-3b1f-4452-8f06-f2060bae822c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:20.828366 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-36b4e4eb-3b1f-4452-8f06-f2060bae822c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:20.847999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e172ec7efcc04b7c98f492c4235a45c5', 'request_id': 'req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.855722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4e4eb-3b1f-4452-8f06-f2060bae822c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:20.856327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e172ec7efcc04b7c98f492c4235a45c5', 'request_id': 'req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.867166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e172ec7efcc04b7c98f492c4235a45c5', 'request_id': 'req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.886396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] The token cache is being invalidate because project e172ec7efcc04b7c98f492c4235a45c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:20.887151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.887948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:20.893456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1014/2036] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:20 2022] DELETE /identity/v3/projects/e172ec7efcc04b7c98f492c4235a45c5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:20.895858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:20.896209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:21.008267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e26d67-1963-4572-a0a0-14185a82c81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:21.012875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e26d67-1963-4572-a0a0-14185a82c81f admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.013163 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e26d67-1963-4572-a0a0-14185a82c81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.014599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e26d67-1963-4572-a0a0-14185a82c81f admin admin] PATH_INFO: `/v3/projects/62b54babccc748878a361398f6ca3461/users/d50a260b1f6d45fea8a0227228f6e34f/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.014907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cfc9d-ee34-4994-91e7-041cdbbef80e admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:21.020530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e26d67-1963-4572-a0a0-14185a82c81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b54babccc748878a361398f6ca3461, user_id=d50a260b1f6d45fea8a0227228f6e34f, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:21.021026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:21.022173 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.022485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.022912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] PATH_INFO: `/v3/users/73d4df045c5743088b85e1374118d45c` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.024789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e26d67-1963-4572-a0a0-14185a82c81f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:21.026843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d4df045c5743088b85e1374118d45c)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:21.028809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:21.046446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1023/2037] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:20 2022] PUT /identity/v3/projects/62b54babccc748878a361398f6ca3461/users/d50a260b1f6d45fea8a0227228f6e34f/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:21.050484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e26d67-1963-4572-a0a0-14185a82c81f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:21.053341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d6e26d67-1963-4572-a0a0-14185a82c81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:21.120527 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:21.134369 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d4df045c5743088b85e1374118d45c'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.135336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d4df045c5743088b85e1374118d45c'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.166531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d4df045c5743088b85e1374118d45c'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.184381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e26d67-1963-4572-a0a0-14185a82c81f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:21.191082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d4df045c5743088b85e1374118d45c'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.195261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:21.196314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.196818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.197105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] PATH_INFO: `/v3/projects/25d85fae8e034ef9971809fa86328ee3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.200769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d85fae8e034ef9971809fa86328ee3)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:21.203659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:21.224456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d4df045c5743088b85e1374118d45c'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.235180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1015/2038] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:20 2022] DELETE /identity/v3/users/73d4df045c5743088b85e1374118d45c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:21.237724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:21.239460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:21.258601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:21.288489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d85fae8e034ef9971809fa86328ee3', 'request_id': 'req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.297910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d85fae8e034ef9971809fa86328ee3', 'request_id': 'req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.308577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d85fae8e034ef9971809fa86328ee3', 'request_id': 'req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.324606 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] The token cache is being invalidate because project 25d85fae8e034ef9971809fa86328ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:21.325053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.325998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e308eecc-b84b-4b3e-8dec-b4b2b209ba19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.328139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1024/2039] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:21 2022] DELETE /identity/v3/projects/25d85fae8e034ef9971809fa86328ee3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:21.333554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39bb0-1027-40c5-ab22-1f849bd9c005 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.333554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39bb0-1027-40c5-ab22-1f849bd9c005 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.333866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39bb0-1027-40c5-ab22-1f849bd9c005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.338141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef1e36-3c15-4899-8a59-1d3c017ab7e4 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:21.355797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-0fa39bb0-1027-40c5-ab22-1f849bd9c005 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:21.357134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0fa39bb0-1027-40c5-ab22-1f849bd9c005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:21.422226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:21.424213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.424495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.424770 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] PATH_INFO: `/v3/projects/5886a5750d3140d79bb5e218d4a2ea78` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.426421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5886a5750d3140d79bb5e218d4a2ea78)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:21.429418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:21.440639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1025/2040] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:21.448924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266423e-a59b-4188-8ab5-799bf7b6e10f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.449046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266423e-a59b-4188-8ab5-799bf7b6e10f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.449454 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266423e-a59b-4188-8ab5-799bf7b6e10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.474656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1266423e-a59b-4188-8ab5-799bf7b6e10f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:21.476049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1266423e-a59b-4188-8ab5-799bf7b6e10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:21.487266 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1026/2041] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:21.492772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266423e-a59b-4188-8ab5-799bf7b6e10f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:21.503224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266423e-a59b-4188-8ab5-799bf7b6e10f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:21.513962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5886a5750d3140d79bb5e218d4a2ea78', 'request_id': 'req-ca4e18a6-d7bf-440d-9572-0297db31c9c5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.521665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5886a5750d3140d79bb5e218d4a2ea78', 'request_id': 'req-ca4e18a6-d7bf-440d-9572-0297db31c9c5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.530916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5886a5750d3140d79bb5e218d4a2ea78', 'request_id': 'req-ca4e18a6-d7bf-440d-9572-0297db31c9c5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.542209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] The token cache is being invalidate because project 5886a5750d3140d79bb5e218d4a2ea78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:21.542609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.543735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.545563 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1016/2042] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:21 2022] DELETE /identity/v3/projects/5886a5750d3140d79bb5e218d4a2ea78 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:21.549652 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:21.551171 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:21.567851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097f668-8dde-4634-8edc-b9413316a270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:21.568425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097f668-8dde-4634-8edc-b9413316a270 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.568776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097f668-8dde-4634-8edc-b9413316a270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.569169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097f668-8dde-4634-8edc-b9413316a270 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.569915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097f668-8dde-4634-8edc-b9413316a270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:21.570657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097f668-8dde-4634-8edc-b9413316a270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:21.572060 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097f668-8dde-4634-8edc-b9413316a270 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:21.588659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1027/2043] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:18:21.592807 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097f668-8dde-4634-8edc-b9413316a270 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:21.595185 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8097f668-8dde-4634-8edc-b9413316a270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:21.606266 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:21.628413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097f668-8dde-4634-8edc-b9413316a270 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:21.642456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486b8a9-8563-43fe-a1ea-d8ffa4ededf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:21.642834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486b8a9-8563-43fe-a1ea-d8ffa4ededf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.643113 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486b8a9-8563-43fe-a1ea-d8ffa4ededf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.643400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486b8a9-8563-43fe-a1ea-d8ffa4ededf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.644105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486b8a9-8563-43fe-a1ea-d8ffa4ededf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:21.647855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:21.648712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486b8a9-8563-43fe-a1ea-d8ffa4ededf5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:21.670952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e18a6-d7bf-440d-9572-0297db31c9c5 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:21.678918 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:21.679993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.680337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.680665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] PATH_INFO: `/v3/users/076b23429a514ae292d5a5478c1a57d2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.682244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=076b23429a514ae292d5a5478c1a57d2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:21.684346 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:21.701545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1028/2044] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:21 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:21.705630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486b8a9-8563-43fe-a1ea-d8ffa4ededf5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:21.755015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076b23429a514ae292d5a5478c1a57d2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.755738 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076b23429a514ae292d5a5478c1a57d2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.769891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076b23429a514ae292d5a5478c1a57d2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.784015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076b23429a514ae292d5a5478c1a57d2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.793076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486b8a9-8563-43fe-a1ea-d8ffa4ededf5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:21.800355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd930f-1e66-47ba-953b-7404c73ccb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:21.801404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd930f-1e66-47ba-953b-7404c73ccb43 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.801404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd930f-1e66-47ba-953b-7404c73ccb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.801666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd930f-1e66-47ba-953b-7404c73ccb43 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.804014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076b23429a514ae292d5a5478c1a57d2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:21.809736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd930f-1e66-47ba-953b-7404c73ccb43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:21.811885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd930f-1e66-47ba-953b-7404c73ccb43 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:21.812273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1017/2045] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:21 2022] DELETE /identity/v3/users/076b23429a514ae292d5a5478c1a57d2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:21.847894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1029/2046] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:21 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:21.852120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:21.853577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:21.923908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c77f2-49db-4c53-baef-b0185ab05297 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:21.929059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304c3e0-0a4d-49a0-a4e0-de36f464172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:21.929755 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c3e0-0a4d-49a0-a4e0-de36f464172c admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.930041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c3e0-0a4d-49a0-a4e0-de36f464172c admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.930341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c3e0-0a4d-49a0-a4e0-de36f464172c admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.931254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304c3e0-0a4d-49a0-a4e0-de36f464172c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:21.932883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304c3e0-0a4d-49a0-a4e0-de36f464172c admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:21.946910 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1018/2047] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:21.948215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd930f-1e66-47ba-953b-7404c73ccb43 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:21.964173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd930f-1e66-47ba-953b-7404c73ccb43 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:21.974928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47992a-9154-4963-88ab-e943ed4b606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:21.976082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47992a-9154-4963-88ab-e943ed4b606a admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:21.977162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47992a-9154-4963-88ab-e943ed4b606a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:21.977622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47992a-9154-4963-88ab-e943ed4b606a admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:21.978609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47992a-9154-4963-88ab-e943ed4b606a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:21.982602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47992a-9154-4963-88ab-e943ed4b606a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:21.999479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1030/2048] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:22.003476 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304c3e0-0a4d-49a0-a4e0-de36f464172c admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:22.015890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304c3e0-0a4d-49a0-a4e0-de36f464172c admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:22.026741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e188d-c09b-4752-84e7-25d4c687c98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:22.027954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e188d-c09b-4752-84e7-25d4c687c98e admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:22.028302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e188d-c09b-4752-84e7-25d4c687c98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:22.028819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e188d-c09b-4752-84e7-25d4c687c98e admin admin] PATH_INFO: `/v3/projects/65f4af25b8944d598e4bf2d51911aaed/users/963dc89e21e3424482b5445315158daf/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:22.052993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e188d-c09b-4752-84e7-25d4c687c98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f4af25b8944d598e4bf2d51911aaed, user_id=963dc89e21e3424482b5445315158daf, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:22.058340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e188d-c09b-4752-84e7-25d4c687c98e admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:22.081997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1019/2049] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:22 2022] PUT /identity/v3/projects/65f4af25b8944d598e4bf2d51911aaed/users/963dc89e21e3424482b5445315158daf/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:22.093282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15a4a0-7893-498b-a84a-18ded46b6cf7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:22.093615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15a4a0-7893-498b-a84a-18ded46b6cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:22.093890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15a4a0-7893-498b-a84a-18ded46b6cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:22.135687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4c15a4a0-7893-498b-a84a-18ded46b6cf7 None None] MFA Rules not processed for user `963dc89e21e3424482b5445315158daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:22.136912 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4c15a4a0-7893-498b-a84a-18ded46b6cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:22.235022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1031/2050] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:22.239965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e188d-c09b-4752-84e7-25d4c687c98e admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:22.313296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:22.322980 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15a4a0-7893-498b-a84a-18ded46b6cf7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:22.325909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4c15a4a0-7893-498b-a84a-18ded46b6cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:22.343006 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e188d-c09b-4752-84e7-25d4c687c98e admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:22.351343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f894b22-d685-4b25-902c-a5957ea386aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:22.351343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894b22-d685-4b25-902c-a5957ea386aa admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:22.351660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894b22-d685-4b25-902c-a5957ea386aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:22.351957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894b22-d685-4b25-902c-a5957ea386aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:22.354785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f894b22-d685-4b25-902c-a5957ea386aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:22.357553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f894b22-d685-4b25-902c-a5957ea386aa admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:22.365413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15a4a0-7893-498b-a84a-18ded46b6cf7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:22.382930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:22.385867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:22.386573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:22.387748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] PATH_INFO: `/v3/projects/bc295d2976dc49789ec2ff14ff6623f2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:22.390953 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc295d2976dc49789ec2ff14ff6623f2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:22.396206 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:22.400705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1020/2051] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:22 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:22.404672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f894b22-d685-4b25-902c-a5957ea386aa admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:22.462127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:22.487608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc295d2976dc49789ec2ff14ff6623f2', 'request_id': 'req-d664f464-b67a-4f81-820e-8bcc9c9667de'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:22.510212 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc295d2976dc49789ec2ff14ff6623f2', 'request_id': 'req-d664f464-b67a-4f81-820e-8bcc9c9667de'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:22.529098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc295d2976dc49789ec2ff14ff6623f2', 'request_id': 'req-d664f464-b67a-4f81-820e-8bcc9c9667de'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:22.559926 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f894b22-d685-4b25-902c-a5957ea386aa admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:22.577286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] The token cache is being invalidate because project bc295d2976dc49789ec2ff14ff6623f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:22.580574 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:22.584827 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:22.592320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1032/2052] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:22 2022] DELETE /identity/v3/projects/bc295d2976dc49789ec2ff14ff6623f2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:22.596098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:22.612111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:22.677643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d37f5-689c-4bc1-8c80-5d3b75df11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:22.678382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d37f5-689c-4bc1-8c80-5d3b75df11ee admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:22.678670 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d37f5-689c-4bc1-8c80-5d3b75df11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:22.678944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d37f5-689c-4bc1-8c80-5d3b75df11ee admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:22.679653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d37f5-689c-4bc1-8c80-5d3b75df11ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:22.681637 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d37f5-689c-4bc1-8c80-5d3b75df11ee admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:22.743402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1021/2053] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:22 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:22.743402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48b9e-e71b-4cda-9bde-612261e43630 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:22.743402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48b9e-e71b-4cda-9bde-612261e43630 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:22.743402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48b9e-e71b-4cda-9bde-612261e43630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:22.769485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-00e48b9e-e71b-4cda-9bde-612261e43630 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:22.777507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664f464-b67a-4f81-820e-8bcc9c9667de admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:22.782100 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:22.783197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:22.787279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:22.787717 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] PATH_INFO: `/v3/projects/b7ef630261d247a6be09c31486092cbb` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:22.789318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ef630261d247a6be09c31486092cbb)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:22.791672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:22.795095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-00e48b9e-e71b-4cda-9bde-612261e43630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:22.825069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1022/2054] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:22.826605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7b0a8-c2a4-485c-b959-30d01cc544b2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:22.826892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7b0a8-c2a4-485c-b959-30d01cc544b2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:22.827166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7b0a8-c2a4-485c-b959-30d01cc544b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:22.864483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-aeb7b0a8-c2a4-485c-b959-30d01cc544b2 None None] MFA Rules not processed for user `d50a260b1f6d45fea8a0227228f6e34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:22.865916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-aeb7b0a8-c2a4-485c-b959-30d01cc544b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:22.887213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ef630261d247a6be09c31486092cbb', 'request_id': 'req-d808d7a0-9830-4560-843f-8d2045e47d60'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:22.895828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ef630261d247a6be09c31486092cbb', 'request_id': 'req-d808d7a0-9830-4560-843f-8d2045e47d60'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:22.909739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ef630261d247a6be09c31486092cbb', 'request_id': 'req-d808d7a0-9830-4560-843f-8d2045e47d60'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:22.931854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] The token cache is being invalidate because project b7ef630261d247a6be09c31486092cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:22.932350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:22.933092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:22.934494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:22.935427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1033/2055] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:22 2022] DELETE /identity/v3/projects/b7ef630261d247a6be09c31486092cbb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:22.935887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:22.937271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:22.977357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1023/2056] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:22.984050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08def2b2-72fa-4137-8c98-d5f6b6738a75 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:22.984452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08def2b2-72fa-4137-8c98-d5f6b6738a75 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:22.985406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08def2b2-72fa-4137-8c98-d5f6b6738a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.007148 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-08def2b2-72fa-4137-8c98-d5f6b6738a75 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:23.008677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-08def2b2-72fa-4137-8c98-d5f6b6738a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:23.027137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d7a0-9830-4560-843f-8d2045e47d60 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.032728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d55ce6-aec6-4c36-ac77-1efc77e303a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.033411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55ce6-aec6-4c36-ac77-1efc77e303a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.033694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55ce6-aec6-4c36-ac77-1efc77e303a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.033971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55ce6-aec6-4c36-ac77-1efc77e303a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.034745 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d55ce6-aec6-4c36-ac77-1efc77e303a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.036361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d55ce6-aec6-4c36-ac77-1efc77e303a7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.039102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:23.055284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1034/2057] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:23.064328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbc2a1-9c1b-42e9-a8d5-09dcb7603334 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.064328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbc2a1-9c1b-42e9-a8d5-09dcb7603334 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.064328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbc2a1-9c1b-42e9-a8d5-09dcb7603334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.082918 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f9cbc2a1-9c1b-42e9-a8d5-09dcb7603334 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:23.084139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f9cbc2a1-9c1b-42e9-a8d5-09dcb7603334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:23.087688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1024/2058] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:23.089067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607205-c5f0-4876-a49c-4032b27f093a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.089421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607205-c5f0-4876-a49c-4032b27f093a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.089769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607205-c5f0-4876-a49c-4032b27f093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.093475 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1035/2059] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:23.101783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbc2a1-9c1b-42e9-a8d5-09dcb7603334 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.110001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-13607205-c5f0-4876-a49c-4032b27f093a None None] MFA Rules not processed for user `e476fa46e893493bae01468dc57ccb12`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:23.112481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbc2a1-9c1b-42e9-a8d5-09dcb7603334 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.116056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-13607205-c5f0-4876-a49c-4032b27f093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:23.117866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283b967-d6fc-4de0-8383-2274232777de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.120298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283b967-d6fc-4de0-8383-2274232777de admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.120584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283b967-d6fc-4de0-8383-2274232777de admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.120886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283b967-d6fc-4de0-8383-2274232777de admin admin] PATH_INFO: `/v3/projects/f03a084188d1413c92ea6a1b43bc147f/users/5daf9f30693d4bcc99484fccf0a35bc0/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.138255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283b967-d6fc-4de0-8383-2274232777de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03a084188d1413c92ea6a1b43bc147f, user_id=5daf9f30693d4bcc99484fccf0a35bc0, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.141786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283b967-d6fc-4de0-8383-2274232777de admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.170058 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1036/2060] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:23 2022] PUT /identity/v3/projects/f03a084188d1413c92ea6a1b43bc147f/users/5daf9f30693d4bcc99484fccf0a35bc0/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:23.171111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283b967-d6fc-4de0-8383-2274232777de admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.188768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1025/2061] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:23.196970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3384d7e-6698-49ec-b2e0-810f68a54f58 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.197261 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3384d7e-6698-49ec-b2e0-810f68a54f58 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.197540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3384d7e-6698-49ec-b2e0-810f68a54f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.217182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-b3384d7e-6698-49ec-b2e0-810f68a54f58 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:23.218343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b3384d7e-6698-49ec-b2e0-810f68a54f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:23.240000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283b967-d6fc-4de0-8383-2274232777de admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.244958 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064081e1-659e-4063-abe9-350e38d954cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.245418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064081e1-659e-4063-abe9-350e38d954cd admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.245690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064081e1-659e-4063-abe9-350e38d954cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.245962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064081e1-659e-4063-abe9-350e38d954cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.246737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064081e1-659e-4063-abe9-350e38d954cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:23.247037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064081e1-659e-4063-abe9-350e38d954cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.248652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064081e1-659e-4063-abe9-350e38d954cd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.260149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1037/2062] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:18:23.260954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064081e1-659e-4063-abe9-350e38d954cd admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.270696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064081e1-659e-4063-abe9-350e38d954cd admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.275304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b9acc-0e55-4ba7-9a40-4e5b2c7ca9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.275963 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b9acc-0e55-4ba7-9a40-4e5b2c7ca9bb admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.276256 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b9acc-0e55-4ba7-9a40-4e5b2c7ca9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.276525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b9acc-0e55-4ba7-9a40-4e5b2c7ca9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.277251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b9acc-0e55-4ba7-9a40-4e5b2c7ca9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.278274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1026/2063] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:23.278888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b9acc-0e55-4ba7-9a40-4e5b2c7ca9bb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.279170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3384d7e-6698-49ec-b2e0-810f68a54f58 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.280533 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b3384d7e-6698-49ec-b2e0-810f68a54f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:23.289566 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1038/2064] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:23.290664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b9acc-0e55-4ba7-9a40-4e5b2c7ca9bb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.300761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b9acc-0e55-4ba7-9a40-4e5b2c7ca9bb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.305627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cb544-5ad6-4a8a-93b9-9a81c7631f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.310910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb544-5ad6-4a8a-93b9-9a81c7631f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.311203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb544-5ad6-4a8a-93b9-9a81c7631f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.311484 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb544-5ad6-4a8a-93b9-9a81c7631f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.312194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cb544-5ad6-4a8a-93b9-9a81c7631f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.315280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cb544-5ad6-4a8a-93b9-9a81c7631f51 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.319261 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:23.343508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1039/2065] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:23 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:23.344410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cb544-5ad6-4a8a-93b9-9a81c7631f51 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.364569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3384d7e-6698-49ec-b2e0-810f68a54f58 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.408403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cb544-5ad6-4a8a-93b9-9a81c7631f51 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.413240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd277b7-9b98-4241-91da-7844a7eebd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.413906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd277b7-9b98-4241-91da-7844a7eebd61 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.414186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd277b7-9b98-4241-91da-7844a7eebd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.414483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd277b7-9b98-4241-91da-7844a7eebd61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.415216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd277b7-9b98-4241-91da-7844a7eebd61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:23.415518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd277b7-9b98-4241-91da-7844a7eebd61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.417134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd277b7-9b98-4241-91da-7844a7eebd61 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.428784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1040/2066] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:18:23.429625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd277b7-9b98-4241-91da-7844a7eebd61 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.430016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ea012-7519-4acb-a46b-97fe9b9f8af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.430672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ea012-7519-4acb-a46b-97fe9b9f8af0 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.430969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ea012-7519-4acb-a46b-97fe9b9f8af0 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.431223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ea012-7519-4acb-a46b-97fe9b9f8af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.433363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d21ea012-7519-4acb-a46b-97fe9b9f8af0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:23.439456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd277b7-9b98-4241-91da-7844a7eebd61 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.444190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c21e4-a15a-413b-ae00-5dd204225dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.445068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c21e4-a15a-413b-ae00-5dd204225dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.445347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c21e4-a15a-413b-ae00-5dd204225dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.445617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c21e4-a15a-413b-ae00-5dd204225dd6 admin admin] PATH_INFO: `/v3/projects/f03a084188d1413c92ea6a1b43bc147f/users/5daf9f30693d4bcc99484fccf0a35bc0/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.447657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c21e4-a15a-413b-ae00-5dd204225dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03a084188d1413c92ea6a1b43bc147f, user_id=5daf9f30693d4bcc99484fccf0a35bc0, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.450275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c21e4-a15a-413b-ae00-5dd204225dd6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.462826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1041/2067] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:23 2022] PUT /identity/v3/projects/f03a084188d1413c92ea6a1b43bc147f/users/5daf9f30693d4bcc99484fccf0a35bc0/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:23.463672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c21e4-a15a-413b-ae00-5dd204225dd6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.477422 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:23.500925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ea012-7519-4acb-a46b-97fe9b9f8af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.502555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ea012-7519-4acb-a46b-97fe9b9f8af0 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.512422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1027/2068] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:23.513242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ea012-7519-4acb-a46b-97fe9b9f8af0 service nova] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.524843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ea012-7519-4acb-a46b-97fe9b9f8af0 service nova] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.537058 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c21e4-a15a-413b-ae00-5dd204225dd6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.542709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cad4b5-25bd-41ce-9b7c-a1ff5924161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.543390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cad4b5-25bd-41ce-9b7c-a1ff5924161c admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.543663 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cad4b5-25bd-41ce-9b7c-a1ff5924161c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.543931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cad4b5-25bd-41ce-9b7c-a1ff5924161c admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.544615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cad4b5-25bd-41ce-9b7c-a1ff5924161c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.546568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cad4b5-25bd-41ce-9b7c-a1ff5924161c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.571177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1042/2069] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:23 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:23.572555 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f4b5-850c-4b01-8839-2ffa2835f231 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.572838 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f4b5-850c-4b01-8839-2ffa2835f231 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.573126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f4b5-850c-4b01-8839-2ffa2835f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.601239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c93c0-1da2-4f06-927a-eb373b89ebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.601890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c93c0-1da2-4f06-927a-eb373b89ebe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.602217 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c93c0-1da2-4f06-927a-eb373b89ebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.602458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c93c0-1da2-4f06-927a-eb373b89ebe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.603406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c93c0-1da2-4f06-927a-eb373b89ebe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.605760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c93c0-1da2-4f06-927a-eb373b89ebe0 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.607843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ae69f4b5-850c-4b01-8839-2ffa2835f231 None None] MFA Rules not processed for user `5daf9f30693d4bcc99484fccf0a35bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:23.609038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ae69f4b5-850c-4b01-8839-2ffa2835f231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:23.611426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:23.654312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1028/2070] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:23 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:23.654312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c93c0-1da2-4f06-927a-eb373b89ebe0 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.721608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1043/2071] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:23.724433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69f4b5-850c-4b01-8839-2ffa2835f231 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.735942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c93c0-1da2-4f06-927a-eb373b89ebe0 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.742505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bbe34-6245-45d7-9233-c1e45e3d5a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.743605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bbe34-6245-45d7-9233-c1e45e3d5a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.744035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bbe34-6245-45d7-9233-c1e45e3d5a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.744420 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bbe34-6245-45d7-9233-c1e45e3d5a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.745406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bbe34-6245-45d7-9233-c1e45e3d5a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.747993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bbe34-6245-45d7-9233-c1e45e3d5a26 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.751910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69f4b5-850c-4b01-8839-2ffa2835f231 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.764097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1029/2072] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:23.764097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bbe34-6245-45d7-9233-c1e45e3d5a26 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.764097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8a8bbe34-6245-45d7-9233-c1e45e3d5a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:23.769195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a2ea9-2dab-4fcc-899d-645e1364d08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.770143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2ea9-2dab-4fcc-899d-645e1364d08b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.770542 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2ea9-2dab-4fcc-899d-645e1364d08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.770767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2ea9-2dab-4fcc-899d-645e1364d08b admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.771946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a2ea9-2dab-4fcc-899d-645e1364d08b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.774920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a2ea9-2dab-4fcc-899d-645e1364d08b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.804150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1044/2073] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:23 2022] POST /identity/v3/users => generated 282 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:23.805035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a2ea9-2dab-4fcc-899d-645e1364d08b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.816418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a2ea9-2dab-4fcc-899d-645e1364d08b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.821548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa028e5d-dd06-4ee2-afdf-93772e350638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.826489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028e5d-dd06-4ee2-afdf-93772e350638 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.827350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028e5d-dd06-4ee2-afdf-93772e350638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.828211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028e5d-dd06-4ee2-afdf-93772e350638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.829466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa028e5d-dd06-4ee2-afdf-93772e350638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.831289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa028e5d-dd06-4ee2-afdf-93772e350638 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.840848 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bbe34-6245-45d7-9233-c1e45e3d5a26 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.842054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1045/2074] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:23.842939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa028e5d-dd06-4ee2-afdf-93772e350638 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.848334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147908a2-a4c0-4a59-bd93-c0de490a93a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.850134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147908a2-a4c0-4a59-bd93-c0de490a93a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.850610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147908a2-a4c0-4a59-bd93-c0de490a93a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.852006 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147908a2-a4c0-4a59-bd93-c0de490a93a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.853864 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa028e5d-dd06-4ee2-afdf-93772e350638 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.859199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577651b5-128e-4f27-8dcd-1b5da4ec7cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.859907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577651b5-128e-4f27-8dcd-1b5da4ec7cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.860190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577651b5-128e-4f27-8dcd-1b5da4ec7cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.860518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577651b5-128e-4f27-8dcd-1b5da4ec7cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.861377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577651b5-128e-4f27-8dcd-1b5da4ec7cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.863056 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577651b5-128e-4f27-8dcd-1b5da4ec7cd6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.874239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1046/2075] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:23.875095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577651b5-128e-4f27-8dcd-1b5da4ec7cd6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.887949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577651b5-128e-4f27-8dcd-1b5da4ec7cd6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:23.894026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50937ecf-c717-42d1-ac8e-ce09e44daccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:23.895308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50937ecf-c717-42d1-ac8e-ce09e44daccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.895663 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50937ecf-c717-42d1-ac8e-ce09e44daccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.896094 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50937ecf-c717-42d1-ac8e-ce09e44daccf admin admin] PATH_INFO: `/v3/projects/80ed3f7ef16e4968ab9252991f24c1c2/users/3f7028f69e984643b8f0f6e21ba6bf5e/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:23.915733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50937ecf-c717-42d1-ac8e-ce09e44daccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ed3f7ef16e4968ab9252991f24c1c2, user_id=3f7028f69e984643b8f0f6e21ba6bf5e, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.918776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50937ecf-c717-42d1-ac8e-ce09e44daccf admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.929276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147908a2-a4c0-4a59-bd93-c0de490a93a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:23.931616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147908a2-a4c0-4a59-bd93-c0de490a93a6 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:23.934119 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1047/2076] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:23 2022] PUT /identity/v3/projects/80ed3f7ef16e4968ab9252991f24c1c2/users/3f7028f69e984643b8f0f6e21ba6bf5e/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:23.935119 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50937ecf-c717-42d1-ac8e-ce09e44daccf admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:23.959023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:23.959176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1030/2077] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:23.961428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae428e5a-aa91-4431-970c-277544083f8a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:23.961715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae428e5a-aa91-4431-970c-277544083f8a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:23.961991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae428e5a-aa91-4431-970c-277544083f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:24.007425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-ae428e5a-aa91-4431-970c-277544083f8a None None] MFA Rules not processed for user `3f7028f69e984643b8f0f6e21ba6bf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:24.008987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ae428e5a-aa91-4431-970c-277544083f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:24.026149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50937ecf-c717-42d1-ac8e-ce09e44daccf admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:24.031331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b158b-522d-4e78-b323-81a770e1e49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:24.032214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b158b-522d-4e78-b323-81a770e1e49c admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:24.032492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b158b-522d-4e78-b323-81a770e1e49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:24.032761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b158b-522d-4e78-b323-81a770e1e49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:24.033670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b158b-522d-4e78-b323-81a770e1e49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:24.035495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b158b-522d-4e78-b323-81a770e1e49c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:24.050108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:24.050793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1048/2078] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:24.052074 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b158b-522d-4e78-b323-81a770e1e49c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:24.064002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b158b-522d-4e78-b323-81a770e1e49c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:24.071930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62f0b9-3e70-4005-bcfe-3c7105d66334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:24.073618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62f0b9-3e70-4005-bcfe-3c7105d66334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:24.073754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62f0b9-3e70-4005-bcfe-3c7105d66334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:24.074218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62f0b9-3e70-4005-bcfe-3c7105d66334 admin admin] PATH_INFO: `/v3/projects/8eac8c53196c4c20a6ae1c875be1af90/users/7a2df150d0c64a00a264e5a582037f94/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:24.109778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62f0b9-3e70-4005-bcfe-3c7105d66334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eac8c53196c4c20a6ae1c875be1af90, user_id=7a2df150d0c64a00a264e5a582037f94, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:24.112735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62f0b9-3e70-4005-bcfe-3c7105d66334 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:24.132188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1031/2079] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:24.135424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1049/2080] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:24 2022] PUT /identity/v3/projects/8eac8c53196c4c20a6ae1c875be1af90/users/7a2df150d0c64a00a264e5a582037f94/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:24.149033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520656-c33f-4240-9e81-c86367a3d2d7 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:24.149033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520656-c33f-4240-9e81-c86367a3d2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:24.149033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520656-c33f-4240-9e81-c86367a3d2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:24.150936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62f0b9-3e70-4005-bcfe-3c7105d66334 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:24.153418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3f62f0b9-3e70-4005-bcfe-3c7105d66334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:24.192909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-93520656-c33f-4240-9e81-c86367a3d2d7 None None] MFA Rules not processed for user `7a2df150d0c64a00a264e5a582037f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:24.194498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-93520656-c33f-4240-9e81-c86367a3d2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:24.243148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62f0b9-3e70-4005-bcfe-3c7105d66334 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:24.247821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea71d-2720-478d-a659-568016d7ce93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:24.248571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea71d-2720-478d-a659-568016d7ce93 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:24.249000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea71d-2720-478d-a659-568016d7ce93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:24.249287 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea71d-2720-478d-a659-568016d7ce93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:24.353944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1032/2081] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:24.366656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ea71d-2720-478d-a659-568016d7ce93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:24.367525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ea71d-2720-478d-a659-568016d7ce93 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:24.378688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1050/2082] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:24.393558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93520656-c33f-4240-9e81-c86367a3d2d7 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:24.403308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea71d-2720-478d-a659-568016d7ce93 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:24.407455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93520656-c33f-4240-9e81-c86367a3d2d7 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:24.415067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44978667-51d7-44fe-8731-2f27404e3b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:24.416011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44978667-51d7-44fe-8731-2f27404e3b9e service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:24.416352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44978667-51d7-44fe-8731-2f27404e3b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:24.416557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44978667-51d7-44fe-8731-2f27404e3b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:24.431709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44978667-51d7-44fe-8731-2f27404e3b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:24.433415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44978667-51d7-44fe-8731-2f27404e3b9e service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:24.445847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1033/2083] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:24.457051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:24.491306 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea71d-2720-478d-a659-568016d7ce93 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:24.497981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:24.499101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:24.499387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:24.499816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] PATH_INFO: `/v3/users/3f7028f69e984643b8f0f6e21ba6bf5e` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:24.505017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7028f69e984643b8f0f6e21ba6bf5e)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:24.508132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:24.596468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7028f69e984643b8f0f6e21ba6bf5e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:24.597142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7028f69e984643b8f0f6e21ba6bf5e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:24.608309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7028f69e984643b8f0f6e21ba6bf5e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:24.630657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7028f69e984643b8f0f6e21ba6bf5e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:24.641099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7028f69e984643b8f0f6e21ba6bf5e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:24.661885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1051/2084] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:24 2022] DELETE /identity/v3/users/3f7028f69e984643b8f0f6e21ba6bf5e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:24.666300 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df933b1-901b-45ae-89b4-ba397be1fa60 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:24.666795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df933b1-901b-45ae-89b4-ba397be1fa60 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:24.666879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df933b1-901b-45ae-89b4-ba397be1fa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:24.688567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-0df933b1-901b-45ae-89b4-ba397be1fa60 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:24.691067 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-0df933b1-901b-45ae-89b4-ba397be1fa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:24.772860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:24.774979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:24.797113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1034/2085] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:24.816260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df933b1-901b-45ae-89b4-ba397be1fa60 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:24.817698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-0df933b1-901b-45ae-89b4-ba397be1fa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:24.889857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cda69-cc04-4d63-99bc-0a711abe1b31 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:24.903765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:24.903987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:24.904134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:24.904134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:24.904134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] PATH_INFO: `/v3/users/963dc89e21e3424482b5445315158daf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:24.904134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=963dc89e21e3424482b5445315158daf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:24.904134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:24.928308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df933b1-901b-45ae-89b4-ba397be1fa60 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:24.931901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f0c2f-1ba4-4ad9-a450-151a29254cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:24.932591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f0c2f-1ba4-4ad9-a450-151a29254cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:24.932896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f0c2f-1ba4-4ad9-a450-151a29254cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:24.933166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f0c2f-1ba4-4ad9-a450-151a29254cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:24.943819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f0c2f-1ba4-4ad9-a450-151a29254cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:24.946954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f0c2f-1ba4-4ad9-a450-151a29254cd6 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:24.961432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1035/2086] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:24.961640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963dc89e21e3424482b5445315158daf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:24.962241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963dc89e21e3424482b5445315158daf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:24.972206 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963dc89e21e3424482b5445315158daf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:24.985607 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:24.989629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963dc89e21e3424482b5445315158daf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.002491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963dc89e21e3424482b5445315158daf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.011884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1052/2087] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:24 2022] DELETE /identity/v3/users/963dc89e21e3424482b5445315158daf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:25.017236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b0223-b5fa-4d26-92c2-84b647c86b9f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:25.017528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b0223-b5fa-4d26-92c2-84b647c86b9f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:25.017808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b0223-b5fa-4d26-92c2-84b647c86b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:25.046037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-001b0223-b5fa-4d26-92c2-84b647c86b9f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:25.048091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-001b0223-b5fa-4d26-92c2-84b647c86b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:25.136141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1036/2088] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:25.151360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:25.159465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:25.260304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09462e6c-9455-48c5-aaa6-148f7ae53bf8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:25.265004 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec987a1-4358-4687-8a33-ad333ae02de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:25.268277 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec987a1-4358-4687-8a33-ad333ae02de4 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:25.268867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec987a1-4358-4687-8a33-ad333ae02de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:25.269173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec987a1-4358-4687-8a33-ad333ae02de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:25.281334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec987a1-4358-4687-8a33-ad333ae02de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:25.283818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec987a1-4358-4687-8a33-ad333ae02de4 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:25.296389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1053/2089] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:25.332969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b0223-b5fa-4d26-92c2-84b647c86b9f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:25.334558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-001b0223-b5fa-4d26-92c2-84b647c86b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:25.348010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b0223-b5fa-4d26-92c2-84b647c86b9f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:25.365431 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:25.366501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:25.367714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:25.368002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] PATH_INFO: `/v3/projects/80ed3f7ef16e4968ab9252991f24c1c2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:25.369359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ed3f7ef16e4968ab9252991f24c1c2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:25.371463 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:25.462097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ed3f7ef16e4968ab9252991f24c1c2', 'request_id': 'req-df04f84b-8fc4-41b4-9a77-14de245bd05f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.469256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ed3f7ef16e4968ab9252991f24c1c2', 'request_id': 'req-df04f84b-8fc4-41b4-9a77-14de245bd05f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.480258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ed3f7ef16e4968ab9252991f24c1c2', 'request_id': 'req-df04f84b-8fc4-41b4-9a77-14de245bd05f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.495026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] The token cache is being invalidate because project 80ed3f7ef16e4968ab9252991f24c1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:25.495026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.495471 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df04f84b-8fc4-41b4-9a77-14de245bd05f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.498489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1037/2090] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:25 2022] DELETE /identity/v3/projects/80ed3f7ef16e4968ab9252991f24c1c2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:25.502729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0f821-2851-4a36-87f9-7e55c0408f7d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:25.503019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0f821-2851-4a36-87f9-7e55c0408f7d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:25.503295 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0f821-2851-4a36-87f9-7e55c0408f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:25.524933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b9b0f821-2851-4a36-87f9-7e55c0408f7d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:25.525637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b9b0f821-2851-4a36-87f9-7e55c0408f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:25.609162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1054/2091] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:25.617334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd11910-32cc-4f4e-ba0b-f5ff9d1aa06c None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:25.617622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd11910-32cc-4f4e-ba0b-f5ff9d1aa06c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:25.617929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd11910-32cc-4f4e-ba0b-f5ff9d1aa06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:25.637367 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-3fd11910-32cc-4f4e-ba0b-f5ff9d1aa06c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:25.638622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3fd11910-32cc-4f4e-ba0b-f5ff9d1aa06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:25.648950 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1038/2092] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:25.653429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0f821-2851-4a36-87f9-7e55c0408f7d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:25.663396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0f821-2851-4a36-87f9-7e55c0408f7d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:25.668245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe7170-cdab-4e1e-8d47-5c85f6bb4f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:25.668915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe7170-cdab-4e1e-8d47-5c85f6bb4f40 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:25.669196 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe7170-cdab-4e1e-8d47-5c85f6bb4f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:25.669471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe7170-cdab-4e1e-8d47-5c85f6bb4f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:25.670237 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe7170-cdab-4e1e-8d47-5c85f6bb4f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:25.670576 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe7170-cdab-4e1e-8d47-5c85f6bb4f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:25.672254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe7170-cdab-4e1e-8d47-5c85f6bb4f40 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:25.686341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1055/2093] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:18:25.689753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd11910-32cc-4f4e-ba0b-f5ff9d1aa06c None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:25.700497 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd11910-32cc-4f4e-ba0b-f5ff9d1aa06c None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:25.701004 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe7170-cdab-4e1e-8d47-5c85f6bb4f40 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:25.703000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5bfe7170-cdab-4e1e-8d47-5c85f6bb4f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:25.705948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40025e8f-e626-4072-b96c-56d92b14f092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:25.706758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025e8f-e626-4072-b96c-56d92b14f092 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:25.707213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025e8f-e626-4072-b96c-56d92b14f092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:25.707334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025e8f-e626-4072-b96c-56d92b14f092 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:25.708051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40025e8f-e626-4072-b96c-56d92b14f092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:25.710046 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40025e8f-e626-4072-b96c-56d92b14f092 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:25.725149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe7170-cdab-4e1e-8d47-5c85f6bb4f40 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:25.735263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:25.736620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:25.736815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:25.736982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] PATH_INFO: `/v3/projects/65f4af25b8944d598e4bf2d51911aaed` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:25.738379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f4af25b8944d598e4bf2d51911aaed)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:25.740881 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:25.742327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1039/2094] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:25 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:25.746343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40025e8f-e626-4072-b96c-56d92b14f092 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:25.793898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:25.798671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f4af25b8944d598e4bf2d51911aaed', 'request_id': 'req-ce9f111b-1437-4f76-b5bf-57189f0fa557'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.807094 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f4af25b8944d598e4bf2d51911aaed', 'request_id': 'req-ce9f111b-1437-4f76-b5bf-57189f0fa557'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.816030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f4af25b8944d598e4bf2d51911aaed', 'request_id': 'req-ce9f111b-1437-4f76-b5bf-57189f0fa557'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.823558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:25.824189 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40025e8f-e626-4072-b96c-56d92b14f092 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:25.829161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] The token cache is being invalidate because project 65f4af25b8944d598e4bf2d51911aaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:25.829526 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.830603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:25.833373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1056/2095] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:25 2022] DELETE /identity/v3/projects/65f4af25b8944d598e4bf2d51911aaed => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:25.838162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:25.840800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:25.931040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f111b-1437-4f76-b5bf-57189f0fa557 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:25.954275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:25.955279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:25.955562 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:25.955838 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] PATH_INFO: `/v3/users/5daf9f30693d4bcc99484fccf0a35bc0` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:25.957422 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5daf9f30693d4bcc99484fccf0a35bc0)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:25.959437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:25.980744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f13585-d297-448c-bf13-599e52e2b4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:25.981571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f13585-d297-448c-bf13-599e52e2b4db admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:25.981845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f13585-d297-448c-bf13-599e52e2b4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:25.982123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f13585-d297-448c-bf13-599e52e2b4db admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:25.983085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f13585-d297-448c-bf13-599e52e2b4db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:25.985917 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f13585-d297-448c-bf13-599e52e2b4db admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:26.042730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1040/2096] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:25 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:26.051379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f13585-d297-448c-bf13-599e52e2b4db admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:26.053178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-01f13585-d297-448c-bf13-599e52e2b4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:26.059939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5daf9f30693d4bcc99484fccf0a35bc0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:26.073760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f13585-d297-448c-bf13-599e52e2b4db admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:26.074323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5daf9f30693d4bcc99484fccf0a35bc0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:26.090005 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af446a-54c4-4bbe-9f89-5434aa45d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:26.090801 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af446a-54c4-4bbe-9f89-5434aa45d494 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:26.091027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af446a-54c4-4bbe-9f89-5434aa45d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:26.091299 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af446a-54c4-4bbe-9f89-5434aa45d494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:26.092460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af446a-54c4-4bbe-9f89-5434aa45d494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:26.096060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af446a-54c4-4bbe-9f89-5434aa45d494 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:26.096295 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5daf9f30693d4bcc99484fccf0a35bc0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:26.121949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5daf9f30693d4bcc99484fccf0a35bc0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:26.125725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1041/2097] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:26.126654 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af446a-54c4-4bbe-9f89-5434aa45d494 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:26.134675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5daf9f30693d4bcc99484fccf0a35bc0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:26.140721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af446a-54c4-4bbe-9f89-5434aa45d494 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:26.145888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d02136-1459-4ff4-b33c-e3dc60bee7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:26.150363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d02136-1459-4ff4-b33c-e3dc60bee7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:26.150363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d02136-1459-4ff4-b33c-e3dc60bee7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:26.150363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d02136-1459-4ff4-b33c-e3dc60bee7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:26.150363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d02136-1459-4ff4-b33c-e3dc60bee7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:26.150794 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1057/2098] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:25 2022] DELETE /identity/v3/users/5daf9f30693d4bcc99484fccf0a35bc0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:26.150894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d02136-1459-4ff4-b33c-e3dc60bee7a9 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:26.167225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1042/2099] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:26.168203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:26.169754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:26.255663 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91559956-8107-407f-9722-92cfd5c3cfba admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:26.269806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5746bd3-99db-45a3-83d4-f181501a1933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:26.270878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5746bd3-99db-45a3-83d4-f181501a1933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:26.271407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5746bd3-99db-45a3-83d4-f181501a1933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:26.271739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5746bd3-99db-45a3-83d4-f181501a1933 admin admin] PATH_INFO: `/v3/projects/d95edf0b8e49458eb703627f8000e07e/users/11943b3f150a4a2ea29d3a772b93a7ae/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:26.289972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5746bd3-99db-45a3-83d4-f181501a1933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95edf0b8e49458eb703627f8000e07e, user_id=11943b3f150a4a2ea29d3a772b93a7ae, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:26.293931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5746bd3-99db-45a3-83d4-f181501a1933 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:26.309609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:26.316162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1058/2100] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:26 2022] PUT /identity/v3/projects/d95edf0b8e49458eb703627f8000e07e/users/11943b3f150a4a2ea29d3a772b93a7ae/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:26.322016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaef8b-dd03-411e-8f49-bc02c763b981 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:26.322587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaef8b-dd03-411e-8f49-bc02c763b981 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:26.323029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaef8b-dd03-411e-8f49-bc02c763b981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:26.343639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-bfdaef8b-dd03-411e-8f49-bc02c763b981 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:26.345680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bfdaef8b-dd03-411e-8f49-bc02c763b981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:26.454522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1043/2101] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:26.469232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5746bd3-99db-45a3-83d4-f181501a1933 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:26.471572 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a5746bd3-99db-45a3-83d4-f181501a1933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:26.585750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5746bd3-99db-45a3-83d4-f181501a1933 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:26.589654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842ff26-2204-446e-ba55-fcac18655177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:26.590360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ff26-2204-446e-ba55-fcac18655177 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:26.590631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ff26-2204-446e-ba55-fcac18655177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:26.590909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ff26-2204-446e-ba55-fcac18655177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:26.603464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842ff26-2204-446e-ba55-fcac18655177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:26.605594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842ff26-2204-446e-ba55-fcac18655177 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:26.620198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1059/2102] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:27.039356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaef8b-dd03-411e-8f49-bc02c763b981 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:27.041548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bfdaef8b-dd03-411e-8f49-bc02c763b981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:27.066822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaef8b-dd03-411e-8f49-bc02c763b981 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:27.072595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:27.073815 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:27.074206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:27.074532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] PATH_INFO: `/v3/projects/f03a084188d1413c92ea6a1b43bc147f` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:27.075975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03a084188d1413c92ea6a1b43bc147f)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:27.079791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:27.141295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:27.144180 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03a084188d1413c92ea6a1b43bc147f', 'request_id': 'req-355d1a4b-0878-4d99-ac5e-d8752da90ce8'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:27.167754 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03a084188d1413c92ea6a1b43bc147f', 'request_id': 'req-355d1a4b-0878-4d99-ac5e-d8752da90ce8'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:27.191474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03a084188d1413c92ea6a1b43bc147f', 'request_id': 'req-355d1a4b-0878-4d99-ac5e-d8752da90ce8'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:27.208609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] The token cache is being invalidate because project f03a084188d1413c92ea6a1b43bc147f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:27.208977 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:27.209720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-355d1a4b-0878-4d99-ac5e-d8752da90ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:27.215186 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1044/2103] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:27 2022] DELETE /identity/v3/projects/f03a084188d1413c92ea6a1b43bc147f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:27.218240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff440b-e9d4-432d-a22d-934db92d375a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:27.219891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff440b-e9d4-432d-a22d-934db92d375a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:27.220605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff440b-e9d4-432d-a22d-934db92d375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:27.248228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-29ff440b-e9d4-432d-a22d-934db92d375a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:27.249747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-29ff440b-e9d4-432d-a22d-934db92d375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:27.323253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1060/2104] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:27.332140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffc3ea-0705-4561-8303-375e92d79583 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:27.332140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffc3ea-0705-4561-8303-375e92d79583 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:27.332489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffc3ea-0705-4561-8303-375e92d79583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:27.356085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6dffc3ea-0705-4561-8303-375e92d79583 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:27.357307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6dffc3ea-0705-4561-8303-375e92d79583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:27.366338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1045/2105] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:27.370831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff440b-e9d4-432d-a22d-934db92d375a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:27.385671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff440b-e9d4-432d-a22d-934db92d375a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:27.395684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699180e9-75f9-4946-a1ad-bd05f9346cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:27.397747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699180e9-75f9-4946-a1ad-bd05f9346cdc admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:27.398285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699180e9-75f9-4946-a1ad-bd05f9346cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:27.398798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699180e9-75f9-4946-a1ad-bd05f9346cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:27.400198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699180e9-75f9-4946-a1ad-bd05f9346cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:27.400771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699180e9-75f9-4946-a1ad-bd05f9346cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:27.403760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699180e9-75f9-4946-a1ad-bd05f9346cdc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:27.425418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1061/2106] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:18:27.427356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffc3ea-0705-4561-8303-375e92d79583 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:27.440703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffc3ea-0705-4561-8303-375e92d79583 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:27.448853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bbb61-781e-48da-920c-5d7cc41eceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:27.449831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bbb61-781e-48da-920c-5d7cc41eceab admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:27.450215 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bbb61-781e-48da-920c-5d7cc41eceab admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:27.450607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bbb61-781e-48da-920c-5d7cc41eceab admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:27.451455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bbb61-781e-48da-920c-5d7cc41eceab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:27.458172 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bbb61-781e-48da-920c-5d7cc41eceab admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:27.502524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1046/2107] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:27 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:27.511102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699180e9-75f9-4946-a1ad-bd05f9346cdc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:27.526019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699180e9-75f9-4946-a1ad-bd05f9346cdc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:27.595241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e25e76-2dcc-47e7-81ef-0855b960daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:27.595984 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e25e76-2dcc-47e7-81ef-0855b960daa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:27.596364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e25e76-2dcc-47e7-81ef-0855b960daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:27.596796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e25e76-2dcc-47e7-81ef-0855b960daa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:27.597684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e25e76-2dcc-47e7-81ef-0855b960daa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:27.600416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e25e76-2dcc-47e7-81ef-0855b960daa0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:27.625519 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1062/2108] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:27 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:27.630100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bbb61-781e-48da-920c-5d7cc41eceab admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:27.643508 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bbb61-781e-48da-920c-5d7cc41eceab admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:27.647763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e05f7-f70c-4dd5-9fa1-764dcd2e0eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:27.648470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e05f7-f70c-4dd5-9fa1-764dcd2e0eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:27.648745 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e05f7-f70c-4dd5-9fa1-764dcd2e0eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:27.649009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e05f7-f70c-4dd5-9fa1-764dcd2e0eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:27.649736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e05f7-f70c-4dd5-9fa1-764dcd2e0eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:27.651378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e05f7-f70c-4dd5-9fa1-764dcd2e0eaa admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:27.666824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1047/2109] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:27.667880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e25e76-2dcc-47e7-81ef-0855b960daa0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:27.680699 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e25e76-2dcc-47e7-81ef-0855b960daa0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:27.685360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca0bd3-d083-48b7-8bc2-a18fe84c7812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:27.686130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca0bd3-d083-48b7-8bc2-a18fe84c7812 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:27.686501 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca0bd3-d083-48b7-8bc2-a18fe84c7812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:27.686839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca0bd3-d083-48b7-8bc2-a18fe84c7812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:27.687655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca0bd3-d083-48b7-8bc2-a18fe84c7812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:27.690047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca0bd3-d083-48b7-8bc2-a18fe84c7812 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:27.701757 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1063/2110] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:27.706666 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e05f7-f70c-4dd5-9fa1-764dcd2e0eaa admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:27.718483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e05f7-f70c-4dd5-9fa1-764dcd2e0eaa admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:27.726077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3de09-30f3-464a-b5f4-43e3daea8676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:27.729432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3de09-30f3-464a-b5f4-43e3daea8676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:27.729862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3de09-30f3-464a-b5f4-43e3daea8676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:27.730356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3de09-30f3-464a-b5f4-43e3daea8676 admin admin] PATH_INFO: `/v3/projects/d0c762f32f9e478aad9b10a3a1feb03b/users/d733734b70e441abbb887a3d5bc56485/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:27.749291 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3de09-30f3-464a-b5f4-43e3daea8676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c762f32f9e478aad9b10a3a1feb03b, user_id=d733734b70e441abbb887a3d5bc56485, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:27.757188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3de09-30f3-464a-b5f4-43e3daea8676 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:27.787113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1048/2111] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:27 2022] PUT /identity/v3/projects/d0c762f32f9e478aad9b10a3a1feb03b/users/d733734b70e441abbb887a3d5bc56485/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:27.798997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107a3a-bb80-4012-a995-ee896bf25035 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:27.799307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107a3a-bb80-4012-a995-ee896bf25035 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:27.799671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107a3a-bb80-4012-a995-ee896bf25035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:27.835619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:27.860740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d8107a3a-bb80-4012-a995-ee896bf25035 None None] MFA Rules not processed for user `d733734b70e441abbb887a3d5bc56485`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:27.882172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d8107a3a-bb80-4012-a995-ee896bf25035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:28.032712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1064/2112] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:28.034064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3de09-30f3-464a-b5f4-43e3daea8676 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:28.187456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3de09-30f3-464a-b5f4-43e3daea8676 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:28.198241 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98dd85-8fd3-43b4-9913-6c43765d029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:28.199623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98dd85-8fd3-43b4-9913-6c43765d029c admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:28.200053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98dd85-8fd3-43b4-9913-6c43765d029c admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:28.200342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98dd85-8fd3-43b4-9913-6c43765d029c admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:28.201605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98dd85-8fd3-43b4-9913-6c43765d029c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:28.205123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98dd85-8fd3-43b4-9913-6c43765d029c admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:28.258229 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1049/2113] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:28 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:28.263813 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8107a3a-bb80-4012-a995-ee896bf25035 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:28.283571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8107a3a-bb80-4012-a995-ee896bf25035 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:28.442234 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724428ec-b3d7-4c57-b105-a8a6d4c7c981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:28.443095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724428ec-b3d7-4c57-b105-a8a6d4c7c981 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:28.443473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724428ec-b3d7-4c57-b105-a8a6d4c7c981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:28.443858 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724428ec-b3d7-4c57-b105-a8a6d4c7c981 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:28.444783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724428ec-b3d7-4c57-b105-a8a6d4c7c981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:28.447009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724428ec-b3d7-4c57-b105-a8a6d4c7c981 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:28.492347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1065/2114] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:28 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:28.493147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98dd85-8fd3-43b4-9913-6c43765d029c admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:28.511599 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98dd85-8fd3-43b4-9913-6c43765d029c admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:28.516997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20399bad-6f46-43e1-b9db-b08240e82372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:28.518004 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20399bad-6f46-43e1-b9db-b08240e82372 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:28.518472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20399bad-6f46-43e1-b9db-b08240e82372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:28.518913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20399bad-6f46-43e1-b9db-b08240e82372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:28.520075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20399bad-6f46-43e1-b9db-b08240e82372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:28.521869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20399bad-6f46-43e1-b9db-b08240e82372 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:28.534980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1050/2115] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:28.538659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724428ec-b3d7-4c57-b105-a8a6d4c7c981 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:28.554221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724428ec-b3d7-4c57-b105-a8a6d4c7c981 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:28.565400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dcd9d-6223-4f1a-8fd4-1ec06f7e1b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:28.567225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dcd9d-6223-4f1a-8fd4-1ec06f7e1b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:28.567767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dcd9d-6223-4f1a-8fd4-1ec06f7e1b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:28.568945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dcd9d-6223-4f1a-8fd4-1ec06f7e1b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:28.570227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dcd9d-6223-4f1a-8fd4-1ec06f7e1b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:28.575695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dcd9d-6223-4f1a-8fd4-1ec06f7e1b6d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:28.593731 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1066/2116] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:28.597796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20399bad-6f46-43e1-b9db-b08240e82372 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:28.613384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20399bad-6f46-43e1-b9db-b08240e82372 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:28.620410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b904-91cd-4e04-aa48-7cf4575da0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:28.621524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b904-91cd-4e04-aa48-7cf4575da0be admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:28.622482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b904-91cd-4e04-aa48-7cf4575da0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:28.622898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b904-91cd-4e04-aa48-7cf4575da0be admin admin] PATH_INFO: `/v3/projects/24fedb3721464ddba085a609b024b2d9/users/c41e2852234a4cc8ace4647ecdd3eb22/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:28.640622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1b904-91cd-4e04-aa48-7cf4575da0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fedb3721464ddba085a609b024b2d9, user_id=c41e2852234a4cc8ace4647ecdd3eb22, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:28.644072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1b904-91cd-4e04-aa48-7cf4575da0be admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:28.676869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1051/2117] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:28 2022] PUT /identity/v3/projects/24fedb3721464ddba085a609b024b2d9/users/c41e2852234a4cc8ace4647ecdd3eb22/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:28.678754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e703f-7dcf-48b3-b705-411c648c4eb0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:28.679066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e703f-7dcf-48b3-b705-411c648c4eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:28.679351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e703f-7dcf-48b3-b705-411c648c4eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:28.714119 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-808e703f-7dcf-48b3-b705-411c648c4eb0 None None] MFA Rules not processed for user `c41e2852234a4cc8ace4647ecdd3eb22`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:28.715477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-808e703f-7dcf-48b3-b705-411c648c4eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:28.807877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1067/2118] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:28.814058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b904-91cd-4e04-aa48-7cf4575da0be admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:28.846552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:28.895044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b904-91cd-4e04-aa48-7cf4575da0be admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:28.901878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61649cdb-da81-48cd-88e2-b7e6359c91be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:28.902711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61649cdb-da81-48cd-88e2-b7e6359c91be admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:28.903113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61649cdb-da81-48cd-88e2-b7e6359c91be admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:28.903445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61649cdb-da81-48cd-88e2-b7e6359c91be admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:28.904249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61649cdb-da81-48cd-88e2-b7e6359c91be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:28.906384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61649cdb-da81-48cd-88e2-b7e6359c91be admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:28.943233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e703f-7dcf-48b3-b705-411c648c4eb0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:28.945052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1052/2119] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:28 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:28.954724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e703f-7dcf-48b3-b705-411c648c4eb0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:28.959640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:29.036362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4e8f-dd70-44b0-8028-271fe9f9e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:29.037216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4e8f-dd70-44b0-8028-271fe9f9e9bf admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:29.037494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4e8f-dd70-44b0-8028-271fe9f9e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:29.037762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4e8f-dd70-44b0-8028-271fe9f9e9bf admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:29.038491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b4e8f-dd70-44b0-8028-271fe9f9e9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:29.040427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b4e8f-dd70-44b0-8028-271fe9f9e9bf admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:29.077759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1068/2120] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:28 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:29.079470 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61649cdb-da81-48cd-88e2-b7e6359c91be admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:29.090696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61649cdb-da81-48cd-88e2-b7e6359c91be admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:29.099540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f4fd6-75d5-4d27-a6b6-4c90fe5d2ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:29.100622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4fd6-75d5-4d27-a6b6-4c90fe5d2ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:29.101799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4fd6-75d5-4d27-a6b6-4c90fe5d2ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:29.102150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4fd6-75d5-4d27-a6b6-4c90fe5d2ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:29.103984 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f4fd6-75d5-4d27-a6b6-4c90fe5d2ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:29.106504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f4fd6-75d5-4d27-a6b6-4c90fe5d2ca2 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:29.129437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1053/2121] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:18:29.130039 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4e8f-dd70-44b0-8028-271fe9f9e9bf admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:29.143632 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4e8f-dd70-44b0-8028-271fe9f9e9bf admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:29.150762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97f2ef-ea2c-46ff-8897-4191a914a360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:29.152740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97f2ef-ea2c-46ff-8897-4191a914a360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:29.153512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97f2ef-ea2c-46ff-8897-4191a914a360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:29.153703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97f2ef-ea2c-46ff-8897-4191a914a360 admin admin] PATH_INFO: `/v3/projects/380a7711627e47daaae1113a6810b14f/users/1de92d7960974001a4419e5467816fa1/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:29.177272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97f2ef-ea2c-46ff-8897-4191a914a360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380a7711627e47daaae1113a6810b14f, user_id=1de92d7960974001a4419e5467816fa1, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:29.187143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97f2ef-ea2c-46ff-8897-4191a914a360 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:29.225718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1069/2122] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:29 2022] PUT /identity/v3/projects/380a7711627e47daaae1113a6810b14f/users/1de92d7960974001a4419e5467816fa1/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:18:29.227636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f4fd6-75d5-4d27-a6b6-4c90fe5d2ca2 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:29.249869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f4fd6-75d5-4d27-a6b6-4c90fe5d2ca2 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:29.368101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a95d1-e681-40db-88da-73350bd29cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:29.369277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a95d1-e681-40db-88da-73350bd29cae admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:29.369723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a95d1-e681-40db-88da-73350bd29cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:29.370151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a95d1-e681-40db-88da-73350bd29cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:29.371081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a95d1-e681-40db-88da-73350bd29cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:29.372883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a95d1-e681-40db-88da-73350bd29cae admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:29.389460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1054/2123] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:29.394234 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97f2ef-ea2c-46ff-8897-4191a914a360 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:29.411640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97f2ef-ea2c-46ff-8897-4191a914a360 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:29.418491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f80e28-49ae-421f-95e0-4ab59f7e9a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:29.419143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f80e28-49ae-421f-95e0-4ab59f7e9a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:29.419608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f80e28-49ae-421f-95e0-4ab59f7e9a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:29.419912 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f80e28-49ae-421f-95e0-4ab59f7e9a03 admin admin] PATH_INFO: `/v3/projects/380a7711627e47daaae1113a6810b14f/users/1de92d7960974001a4419e5467816fa1/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:29.422321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f80e28-49ae-421f-95e0-4ab59f7e9a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380a7711627e47daaae1113a6810b14f, user_id=1de92d7960974001a4419e5467816fa1, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:29.426490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f80e28-49ae-421f-95e0-4ab59f7e9a03 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:29.439207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1070/2124] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:29 2022] PUT /identity/v3/projects/380a7711627e47daaae1113a6810b14f/users/1de92d7960974001a4419e5467816fa1/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:29.449411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3880f4-e1af-4c45-95b0-34ba998454d1 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:29.449701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3880f4-e1af-4c45-95b0-34ba998454d1 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:29.449982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3880f4-e1af-4c45-95b0-34ba998454d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:29.512938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-cf3880f4-e1af-4c45-95b0-34ba998454d1 None None] MFA Rules not processed for user `1de92d7960974001a4419e5467816fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:29.514200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cf3880f4-e1af-4c45-95b0-34ba998454d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:29.666511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1055/2125] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:29.675697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f80e28-49ae-421f-95e0-4ab59f7e9a03 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:29.677530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d9f80e28-49ae-421f-95e0-4ab59f7e9a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:29.764862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f80e28-49ae-421f-95e0-4ab59f7e9a03 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:29.769443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74988ee-778a-4b30-bc4d-2da9d05bfca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:29.770465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74988ee-778a-4b30-bc4d-2da9d05bfca9 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:29.771116 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74988ee-778a-4b30-bc4d-2da9d05bfca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:29.771709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74988ee-778a-4b30-bc4d-2da9d05bfca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:29.783973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74988ee-778a-4b30-bc4d-2da9d05bfca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:29.785702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74988ee-778a-4b30-bc4d-2da9d05bfca9 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:29.806655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1071/2126] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:30.609284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3880f4-e1af-4c45-95b0-34ba998454d1 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:30.611007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cf3880f4-e1af-4c45-95b0-34ba998454d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:30.637123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3880f4-e1af-4c45-95b0-34ba998454d1 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:30.641734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefdea1-f577-4d8e-adca-da8c16e872eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:30.642689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefdea1-f577-4d8e-adca-da8c16e872eb service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:30.643135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefdea1-f577-4d8e-adca-da8c16e872eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:30.643411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefdea1-f577-4d8e-adca-da8c16e872eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:30.686507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:30.822811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefdea1-f577-4d8e-adca-da8c16e872eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:30.824505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefdea1-f577-4d8e-adca-da8c16e872eb service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:30.868056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1056/2127] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:32.995585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822f875-2a10-47d8-b8d3-45ef684fe711 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:32.996433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822f875-2a10-47d8-b8d3-45ef684fe711 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:32.996891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822f875-2a10-47d8-b8d3-45ef684fe711 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:32.998707 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1072/2128] 10.222.0.23 () {54 vars in 921 bytes} [Tue Jun 28 03:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:18:33.018853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990cf6d-dfcf-4d5f-988b-474778ac30aa None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:33.019395 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990cf6d-dfcf-4d5f-988b-474778ac30aa None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:33.019604 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990cf6d-dfcf-4d5f-988b-474778ac30aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:33.045329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-d990cf6d-dfcf-4d5f-988b-474778ac30aa None None] MFA Rules not processed for user `28b8048235c6421eae12ca99f80ed5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:33.046925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d990cf6d-dfcf-4d5f-988b-474778ac30aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:33.091526 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822f875-2a10-47d8-b8d3-45ef684fe711 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:33.094569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f822f875-2a10-47d8-b8d3-45ef684fe711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:33.138943 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1057/2129] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Jun 28 03:18:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:33.155875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990cf6d-dfcf-4d5f-988b-474778ac30aa None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:33.157437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d990cf6d-dfcf-4d5f-988b-474778ac30aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:33.180916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990cf6d-dfcf-4d5f-988b-474778ac30aa None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:33.188073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8985fe2-df4a-49c8-9707-3eef4ff8f711 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8048235c6421eae12ca99f80ed5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:33.188985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8985fe2-df4a-49c8-9707-3eef4ff8f711 service placement] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:33.189414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8985fe2-df4a-49c8-9707-3eef4ff8f711 service placement] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:33.189830 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8985fe2-df4a-49c8-9707-3eef4ff8f711 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:33.206550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8985fe2-df4a-49c8-9707-3eef4ff8f711 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:33.211146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8985fe2-df4a-49c8-9707-3eef4ff8f711 service placement] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:33.236593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1058/2130] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:33.272561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822f875-2a10-47d8-b8d3-45ef684fe711 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:33.277560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab5761-1855-4dc7-bf5e-5ddffc374704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:33.278514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5761-1855-4dc7-bf5e-5ddffc374704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:33.278797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5761-1855-4dc7-bf5e-5ddffc374704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:33.279112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5761-1855-4dc7-bf5e-5ddffc374704 admin admin] PATH_INFO: `/v3/users/3f1875b5d8924eb29720e07e784fdd82` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:33.280350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab5761-1855-4dc7-bf5e-5ddffc374704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1875b5d8924eb29720e07e784fdd82)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:33.284217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab5761-1855-4dc7-bf5e-5ddffc374704 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:33.291249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:33.371387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-33ab5761-1855-4dc7-bf5e-5ddffc374704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1875b5d8924eb29720e07e784fdd82'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:33.372752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-33ab5761-1855-4dc7-bf5e-5ddffc374704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1875b5d8924eb29720e07e784fdd82'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:33.382502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-33ab5761-1855-4dc7-bf5e-5ddffc374704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1875b5d8924eb29720e07e784fdd82'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:33.397460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-33ab5761-1855-4dc7-bf5e-5ddffc374704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1875b5d8924eb29720e07e784fdd82'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:33.411086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-33ab5761-1855-4dc7-bf5e-5ddffc374704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1875b5d8924eb29720e07e784fdd82'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:33.422317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1073/2131] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:33 2022] DELETE /identity/v3/users/3f1875b5d8924eb29720e07e784fdd82 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:33.702503 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8985fe2-df4a-49c8-9707-3eef4ff8f711 service placement] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:33.718973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8985fe2-df4a-49c8-9707-3eef4ff8f711 service placement] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:33.867252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:33.868332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:33.869138 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:33.869423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] PATH_INFO: `/v3/projects/ccc93255837e4cea8443fe6b2692e523` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:33.871910 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc93255837e4cea8443fe6b2692e523)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:33.875416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:33.976578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:33.998143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc93255837e4cea8443fe6b2692e523', 'request_id': 'req-45476028-d81a-4d75-9e4e-9f7bfbc5757a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:34.011934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc93255837e4cea8443fe6b2692e523', 'request_id': 'req-45476028-d81a-4d75-9e4e-9f7bfbc5757a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:34.034020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc93255837e4cea8443fe6b2692e523', 'request_id': 'req-45476028-d81a-4d75-9e4e-9f7bfbc5757a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:34.048515 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] The token cache is being invalidate because project ccc93255837e4cea8443fe6b2692e523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:34.049389 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:34.050559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-45476028-d81a-4d75-9e4e-9f7bfbc5757a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:34.053739 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1059/2132] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:33 2022] DELETE /identity/v3/projects/ccc93255837e4cea8443fe6b2692e523 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:34.059402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa266a-6a06-4201-9308-a89b497a68bc None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:34.060222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa266a-6a06-4201-9308-a89b497a68bc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:34.060692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa266a-6a06-4201-9308-a89b497a68bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:34.087344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-0aaa266a-6a06-4201-9308-a89b497a68bc None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:34.089221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0aaa266a-6a06-4201-9308-a89b497a68bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:34.176133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1074/2133] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:34.184692 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8068b-6a44-4884-bba1-e66119a48c1e None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:34.184987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8068b-6a44-4884-bba1-e66119a48c1e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:34.185401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8068b-6a44-4884-bba1-e66119a48c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:34.225689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-cad8068b-6a44-4884-bba1-e66119a48c1e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:34.229428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cad8068b-6a44-4884-bba1-e66119a48c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:34.256893 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa266a-6a06-4201-9308-a89b497a68bc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:34.279203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa266a-6a06-4201-9308-a89b497a68bc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:34.280187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1060/2134] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:34.294783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cec3c1-75b9-4ca0-b269-606ad9e8c3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:34.295477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cec3c1-75b9-4ca0-b269-606ad9e8c3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:34.295774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cec3c1-75b9-4ca0-b269-606ad9e8c3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:34.296049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cec3c1-75b9-4ca0-b269-606ad9e8c3a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:34.296808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cec3c1-75b9-4ca0-b269-606ad9e8c3a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:34.297161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cec3c1-75b9-4ca0-b269-606ad9e8c3a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:34.303001 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cec3c1-75b9-4ca0-b269-606ad9e8c3a5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:34.333596 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1075/2135] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:18:34.335367 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8068b-6a44-4884-bba1-e66119a48c1e None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:34.345645 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8068b-6a44-4884-bba1-e66119a48c1e None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:34.350859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f8929-d716-42aa-a2cf-3e365d0f9c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:34.351636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8929-d716-42aa-a2cf-3e365d0f9c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:34.352019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8929-d716-42aa-a2cf-3e365d0f9c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:34.352389 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8929-d716-42aa-a2cf-3e365d0f9c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:34.353305 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f8929-d716-42aa-a2cf-3e365d0f9c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:34.355465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f8929-d716-42aa-a2cf-3e365d0f9c65 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:34.411559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1061/2136] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:34 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:34.413655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cec3c1-75b9-4ca0-b269-606ad9e8c3a5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:34.431577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cec3c1-75b9-4ca0-b269-606ad9e8c3a5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:34.530177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b7fbc-1271-4c6c-ab8c-e6062be88653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:34.531012 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b7fbc-1271-4c6c-ab8c-e6062be88653 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:34.531614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b7fbc-1271-4c6c-ab8c-e6062be88653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:34.531958 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b7fbc-1271-4c6c-ab8c-e6062be88653 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:34.532912 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b7fbc-1271-4c6c-ab8c-e6062be88653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:34.535123 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b7fbc-1271-4c6c-ab8c-e6062be88653 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:34.557969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:34.573972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1076/2137] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:34 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:34.577796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f8929-d716-42aa-a2cf-3e365d0f9c65 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:34.589421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f8929-d716-42aa-a2cf-3e365d0f9c65 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:34.595706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575d3f8-3304-4d72-b268-566a86d0d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:34.596644 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575d3f8-3304-4d72-b268-566a86d0d231 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:34.597007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575d3f8-3304-4d72-b268-566a86d0d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:34.597269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575d3f8-3304-4d72-b268-566a86d0d231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:34.597955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575d3f8-3304-4d72-b268-566a86d0d231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:34.600041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575d3f8-3304-4d72-b268-566a86d0d231 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:34.615953 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b7fbc-1271-4c6c-ab8c-e6062be88653 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:34.622396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1062/2138] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:34.639512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b7fbc-1271-4c6c-ab8c-e6062be88653 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:34.651612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6ef1e-65f1-4338-80ad-d62c98f28e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:34.652536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6ef1e-65f1-4338-80ad-d62c98f28e6e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:34.653179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6ef1e-65f1-4338-80ad-d62c98f28e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:34.654614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6ef1e-65f1-4338-80ad-d62c98f28e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:34.655594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6ef1e-65f1-4338-80ad-d62c98f28e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:34.658343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6ef1e-65f1-4338-80ad-d62c98f28e6e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:34.676452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1077/2139] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:34.677571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575d3f8-3304-4d72-b268-566a86d0d231 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:34.693125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575d3f8-3304-4d72-b268-566a86d0d231 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:34.701971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451058e-1601-48b8-8b31-cd8e0c424441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:34.703018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451058e-1601-48b8-8b31-cd8e0c424441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:34.703499 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451058e-1601-48b8-8b31-cd8e0c424441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:34.703925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451058e-1601-48b8-8b31-cd8e0c424441 admin admin] PATH_INFO: `/v3/projects/308d0d3a16c64139a9d7e768622315b2/users/48ed1f29820f44bdb78f59bce994c840/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:34.721733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451058e-1601-48b8-8b31-cd8e0c424441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=308d0d3a16c64139a9d7e768622315b2, user_id=48ed1f29820f44bdb78f59bce994c840, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:34.724992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451058e-1601-48b8-8b31-cd8e0c424441 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:34.746506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1063/2140] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:34 2022] PUT /identity/v3/projects/308d0d3a16c64139a9d7e768622315b2/users/48ed1f29820f44bdb78f59bce994c840/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:34.749213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef625a20-a3b0-4ba8-a2a5-1fc3cce58fe3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:34.749817 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef625a20-a3b0-4ba8-a2a5-1fc3cce58fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:34.750220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef625a20-a3b0-4ba8-a2a5-1fc3cce58fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:34.781706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ef625a20-a3b0-4ba8-a2a5-1fc3cce58fe3 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:34.783612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ef625a20-a3b0-4ba8-a2a5-1fc3cce58fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:34.881854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1078/2141] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:34.888750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451058e-1601-48b8-8b31-cd8e0c424441 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:34.890976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3451058e-1601-48b8-8b31-cd8e0c424441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:34.904265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5381a-7ae8-412e-bc5e-0d4e6e945e8e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:34.904718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5381a-7ae8-412e-bc5e-0d4e6e945e8e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:34.905722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5381a-7ae8-412e-bc5e-0d4e6e945e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:34.967982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6ab5381a-7ae8-412e-bc5e-0d4e6e945e8e None None] MFA Rules not processed for user `11943b3f150a4a2ea29d3a772b93a7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:34.970834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6ab5381a-7ae8-412e-bc5e-0d4e6e945e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:35.005995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451058e-1601-48b8-8b31-cd8e0c424441 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:35.011374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c457-1e12-4e1d-b9b4-64555d730f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:35.012227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c457-1e12-4e1d-b9b4-64555d730f1f service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:35.012707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c457-1e12-4e1d-b9b4-64555d730f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:35.013049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c457-1e12-4e1d-b9b4-64555d730f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:35.024121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305c457-1e12-4e1d-b9b4-64555d730f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:35.025665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305c457-1e12-4e1d-b9b4-64555d730f1f service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:35.037132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1064/2142] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:35.080460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1079/2143] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:35.084634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c457-1e12-4e1d-b9b4-64555d730f1f service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:35.086266 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8305c457-1e12-4e1d-b9b4-64555d730f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:35.103602 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c457-1e12-4e1d-b9b4-64555d730f1f service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:35.112032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b24635-42b3-4765-b08d-855432c30b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:35.112896 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b24635-42b3-4765-b08d-855432c30b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:35.113181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b24635-42b3-4765-b08d-855432c30b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:35.113616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b24635-42b3-4765-b08d-855432c30b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:35.114560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b24635-42b3-4765-b08d-855432c30b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:35.116660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b24635-42b3-4765-b08d-855432c30b43 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:35.149034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1065/2144] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:35 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:35.153048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5381a-7ae8-412e-bc5e-0d4e6e945e8e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:35.166223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5381a-7ae8-412e-bc5e-0d4e6e945e8e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:35.239349 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155bd81-a395-428c-b9bc-75566315f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:35.240115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155bd81-a395-428c-b9bc-75566315f910 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:35.240395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155bd81-a395-428c-b9bc-75566315f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:35.240670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155bd81-a395-428c-b9bc-75566315f910 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:35.241368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155bd81-a395-428c-b9bc-75566315f910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:35.243361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155bd81-a395-428c-b9bc-75566315f910 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:35.268262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1080/2145] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:35 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:18:35.272328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b24635-42b3-4765-b08d-855432c30b43 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:35.294029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b24635-42b3-4765-b08d-855432c30b43 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:35.302866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fea62-50ae-42d2-b091-e8dff20107ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:35.303900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fea62-50ae-42d2-b091-e8dff20107ca admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:35.304525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fea62-50ae-42d2-b091-e8dff20107ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:35.304897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fea62-50ae-42d2-b091-e8dff20107ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:35.305724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fea62-50ae-42d2-b091-e8dff20107ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:35.308012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fea62-50ae-42d2-b091-e8dff20107ca admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:35.322393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1066/2146] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:35.326688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155bd81-a395-428c-b9bc-75566315f910 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:35.342662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155bd81-a395-428c-b9bc-75566315f910 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:35.356655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543a12a-b7c1-4ed9-a367-167a2270402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:35.356655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543a12a-b7c1-4ed9-a367-167a2270402b admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:35.356655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543a12a-b7c1-4ed9-a367-167a2270402b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:35.356655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543a12a-b7c1-4ed9-a367-167a2270402b admin admin] PATH_INFO: `/v3/projects/fab994de2ca84c9b8b6c6e3d0496ed4f/users/b4bfd7fbb9964920bdd5ceefc88f8609/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:35.356959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:35.375529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543a12a-b7c1-4ed9-a367-167a2270402b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab994de2ca84c9b8b6c6e3d0496ed4f, user_id=b4bfd7fbb9964920bdd5ceefc88f8609, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:35.378736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543a12a-b7c1-4ed9-a367-167a2270402b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:35.397638 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1081/2147] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:35 2022] PUT /identity/v3/projects/fab994de2ca84c9b8b6c6e3d0496ed4f/users/b4bfd7fbb9964920bdd5ceefc88f8609/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:35.405122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fea62-50ae-42d2-b091-e8dff20107ca admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:35.423759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fea62-50ae-42d2-b091-e8dff20107ca admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:35.525439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:35.587541 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8db6e5-1902-4802-bfd7-784529987dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:35.593239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8db6e5-1902-4802-bfd7-784529987dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:35.593662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8db6e5-1902-4802-bfd7-784529987dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:35.594092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8db6e5-1902-4802-bfd7-784529987dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:35.598243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8db6e5-1902-4802-bfd7-784529987dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:35.604016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8db6e5-1902-4802-bfd7-784529987dd6 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:35.625563 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1067/2148] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:35.627104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543a12a-b7c1-4ed9-a367-167a2270402b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:35.642750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543a12a-b7c1-4ed9-a367-167a2270402b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:35.652574 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec46e01-30f1-450a-a899-26149430c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:35.654067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46e01-30f1-450a-a899-26149430c354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:35.655261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46e01-30f1-450a-a899-26149430c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:35.655957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46e01-30f1-450a-a899-26149430c354 admin admin] PATH_INFO: `/v3/projects/fab994de2ca84c9b8b6c6e3d0496ed4f/users/b4bfd7fbb9964920bdd5ceefc88f8609/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:35.663245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec46e01-30f1-450a-a899-26149430c354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab994de2ca84c9b8b6c6e3d0496ed4f, user_id=b4bfd7fbb9964920bdd5ceefc88f8609, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:35.679597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8db6e5-1902-4802-bfd7-784529987dd6 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:35.681543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ce8db6e5-1902-4802-bfd7-784529987dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:35.681945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec46e01-30f1-450a-a899-26149430c354 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:35.709091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1082/2149] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:35 2022] PUT /identity/v3/projects/fab994de2ca84c9b8b6c6e3d0496ed4f/users/b4bfd7fbb9964920bdd5ceefc88f8609/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:35.830020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8db6e5-1902-4802-bfd7-784529987dd6 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:35.909438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4bf3f-198e-495d-bb3f-0df2e069cc59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:35.910833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4bf3f-198e-495d-bb3f-0df2e069cc59 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:35.911365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4bf3f-198e-495d-bb3f-0df2e069cc59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:35.911901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4bf3f-198e-495d-bb3f-0df2e069cc59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:35.914861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d7e4bf3f-198e-495d-bb3f-0df2e069cc59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:36.032901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4bf3f-198e-495d-bb3f-0df2e069cc59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:36.035705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4bf3f-198e-495d-bb3f-0df2e069cc59 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:36.052526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1068/2150] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:39.638605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec46e01-30f1-450a-a899-26149430c354 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:39.640455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-eec46e01-30f1-450a-a899-26149430c354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:39.793613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec46e01-30f1-450a-a899-26149430c354 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:39.810634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:39.811986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:39.812287 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:39.812715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] PATH_INFO: `/v3/users/d733734b70e441abbb887a3d5bc56485` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:39.814208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d733734b70e441abbb887a3d5bc56485)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:39.816207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:39.955225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd733734b70e441abbb887a3d5bc56485'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:39.956177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd733734b70e441abbb887a3d5bc56485'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:39.987773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd733734b70e441abbb887a3d5bc56485'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:40.030759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd733734b70e441abbb887a3d5bc56485'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:40.075284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd733734b70e441abbb887a3d5bc56485'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:40.093215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1083/2151] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:39 2022] DELETE /identity/v3/users/d733734b70e441abbb887a3d5bc56485 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:40.099827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89991fb-3d45-426a-9159-ef24aeeadfd7 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:40.101007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89991fb-3d45-426a-9159-ef24aeeadfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:40.101572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89991fb-3d45-426a-9159-ef24aeeadfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:40.156306 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:40.158806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:40.190594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-a89991fb-3d45-426a-9159-ef24aeeadfd7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:40.192655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a89991fb-3d45-426a-9159-ef24aeeadfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:40.309720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:40.317643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b4a59-feaa-482f-911d-feb70dbb5a99 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:40.327085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f30c6b-ab14-44cd-b85d-9ff76137030e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:40.327937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f30c6b-ab14-44cd-b85d-9ff76137030e service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:40.328454 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f30c6b-ab14-44cd-b85d-9ff76137030e service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:40.329583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f30c6b-ab14-44cd-b85d-9ff76137030e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:40.331552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-05f30c6b-ab14-44cd-b85d-9ff76137030e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:40.449722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:40.517370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1069/2152] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:40.532252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89991fb-3d45-426a-9159-ef24aeeadfd7 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:40.534039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a89991fb-3d45-426a-9159-ef24aeeadfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:40.579825 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f30c6b-ab14-44cd-b85d-9ff76137030e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:40.583828 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f30c6b-ab14-44cd-b85d-9ff76137030e service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:40.621343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1084/2153] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:40.703740 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89991fb-3d45-426a-9159-ef24aeeadfd7 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:40.719937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095f2a2-f786-42fc-ab30-57ec32183574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:40.720743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095f2a2-f786-42fc-ab30-57ec32183574 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:40.721039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095f2a2-f786-42fc-ab30-57ec32183574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:40.721481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095f2a2-f786-42fc-ab30-57ec32183574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:40.764251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095f2a2-f786-42fc-ab30-57ec32183574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:40.765862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095f2a2-f786-42fc-ab30-57ec32183574 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:40.788614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1070/2154] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:18:41.539138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f30c6b-ab14-44cd-b85d-9ff76137030e service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:41.541394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-05f30c6b-ab14-44cd-b85d-9ff76137030e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:41.570812 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f30c6b-ab14-44cd-b85d-9ff76137030e service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:41.584390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:41.584935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:41.585231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:41.585488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] PATH_INFO: `/v3/projects/d0c762f32f9e478aad9b10a3a1feb03b` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:41.590178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c762f32f9e478aad9b10a3a1feb03b)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:41.594325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:41.705304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c762f32f9e478aad9b10a3a1feb03b', 'request_id': 'req-f35846c6-ad50-4ee0-9953-13f56eb94238'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:41.716538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c762f32f9e478aad9b10a3a1feb03b', 'request_id': 'req-f35846c6-ad50-4ee0-9953-13f56eb94238'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:41.727405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c762f32f9e478aad9b10a3a1feb03b', 'request_id': 'req-f35846c6-ad50-4ee0-9953-13f56eb94238'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:41.743463 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] The token cache is being invalidate because project d0c762f32f9e478aad9b10a3a1feb03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:41.743889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:41.744988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:41.748738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1085/2155] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:41 2022] DELETE /identity/v3/projects/d0c762f32f9e478aad9b10a3a1feb03b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:41.752884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095f2a2-f786-42fc-ab30-57ec32183574 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:41.765272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095f2a2-f786-42fc-ab30-57ec32183574 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:41.900056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:41.901206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:41.902503 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:41.902874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] PATH_INFO: `/v3/users/c41e2852234a4cc8ace4647ecdd3eb22` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:41.914324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41e2852234a4cc8ace4647ecdd3eb22)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:41.920622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:42.046240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41e2852234a4cc8ace4647ecdd3eb22'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:42.048704 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41e2852234a4cc8ace4647ecdd3eb22'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:42.076186 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41e2852234a4cc8ace4647ecdd3eb22'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:42.096576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41e2852234a4cc8ace4647ecdd3eb22'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:42.128187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41e2852234a4cc8ace4647ecdd3eb22'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:42.150897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1071/2156] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:41 2022] DELETE /identity/v3/users/c41e2852234a4cc8ace4647ecdd3eb22 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:43.149468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:43.151870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:43.175913 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35846c6-ad50-4ee0-9953-13f56eb94238 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:43.333252 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:43.334902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:43.335311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:43.335632 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] PATH_INFO: `/v3/projects/24fedb3721464ddba085a609b024b2d9` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:43.337533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24fedb3721464ddba085a609b024b2d9)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:43.340766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:43.393095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:43.469149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24fedb3721464ddba085a609b024b2d9', 'request_id': 'req-5d9fcc35-fc1e-403b-b828-c87a2510ef51'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:43.486778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24fedb3721464ddba085a609b024b2d9', 'request_id': 'req-5d9fcc35-fc1e-403b-b828-c87a2510ef51'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:43.520274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24fedb3721464ddba085a609b024b2d9', 'request_id': 'req-5d9fcc35-fc1e-403b-b828-c87a2510ef51'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:43.551189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] The token cache is being invalidate because project 24fedb3721464ddba085a609b024b2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:43.551546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:43.552202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:43.562047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1086/2157] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:43 2022] DELETE /identity/v3/projects/24fedb3721464ddba085a609b024b2d9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:43.566421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:43.568235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:43.582513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:43.595814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d0043-60b0-4488-8fc8-eb2e20ded3ec admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:43.695722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70285c2c-356e-42e3-a552-b9fd3f52ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:43.696134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285c2c-356e-42e3-a552-b9fd3f52ed40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:43.696545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285c2c-356e-42e3-a552-b9fd3f52ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:43.696923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285c2c-356e-42e3-a552-b9fd3f52ed40 admin admin] PATH_INFO: `/v3/users/1de92d7960974001a4419e5467816fa1` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:43.706072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70285c2c-356e-42e3-a552-b9fd3f52ed40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de92d7960974001a4419e5467816fa1)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:43.708755 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70285c2c-356e-42e3-a552-b9fd3f52ed40 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:43.822220 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-70285c2c-356e-42e3-a552-b9fd3f52ed40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de92d7960974001a4419e5467816fa1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:43.823362 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-70285c2c-356e-42e3-a552-b9fd3f52ed40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de92d7960974001a4419e5467816fa1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:43.834788 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-70285c2c-356e-42e3-a552-b9fd3f52ed40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de92d7960974001a4419e5467816fa1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:43.846543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-70285c2c-356e-42e3-a552-b9fd3f52ed40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de92d7960974001a4419e5467816fa1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:43.868151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-70285c2c-356e-42e3-a552-b9fd3f52ed40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de92d7960974001a4419e5467816fa1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:43.883888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1072/2158] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:18:43 2022] DELETE /identity/v3/users/1de92d7960974001a4419e5467816fa1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:44.968029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:44.970187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:44.995787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fcc35-fc1e-403b-b828-c87a2510ef51 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:45.138924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:45.139956 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:45.140308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:45.140776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] PATH_INFO: `/v3/projects/380a7711627e47daaae1113a6810b14f` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:45.142435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] RBAC: Authorizing `identity:delete_project(project_id=380a7711627e47daaae1113a6810b14f)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:45.149575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:45.240398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380a7711627e47daaae1113a6810b14f', 'request_id': 'req-b259d68b-a318-4ad1-9e93-47ae8ce707af'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:45.248957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380a7711627e47daaae1113a6810b14f', 'request_id': 'req-b259d68b-a318-4ad1-9e93-47ae8ce707af'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:45.272193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380a7711627e47daaae1113a6810b14f', 'request_id': 'req-b259d68b-a318-4ad1-9e93-47ae8ce707af'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:45.296496 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] The token cache is being invalidate because project 380a7711627e47daaae1113a6810b14f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:18:45.297393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:45.298205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b259d68b-a318-4ad1-9e93-47ae8ce707af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:18:45.299956 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1087/2159] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:18:44 2022] DELETE /identity/v3/projects/380a7711627e47daaae1113a6810b14f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:45.306190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af446f-3f9d-4e81-b466-3c7e441db12e None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:45.308490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af446f-3f9d-4e81-b466-3c7e441db12e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:45.310093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af446f-3f9d-4e81-b466-3c7e441db12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:45.336651 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-08af446f-3f9d-4e81-b466-3c7e441db12e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:45.338765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-08af446f-3f9d-4e81-b466-3c7e441db12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:45.509731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1073/2160] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:45.510506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a603e4-4333-4f2c-aad4-88b8094656de None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:45.510908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a603e4-4333-4f2c-aad4-88b8094656de None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:45.511070 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a603e4-4333-4f2c-aad4-88b8094656de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:45.539057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-18a603e4-4333-4f2c-aad4-88b8094656de None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:45.540695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-18a603e4-4333-4f2c-aad4-88b8094656de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:45.554939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1088/2161] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:45.561263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af446f-3f9d-4e81-b466-3c7e441db12e None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:45.576766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af446f-3f9d-4e81-b466-3c7e441db12e None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:45.595420 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c79e-d6d9-4304-a11b-1540e81755b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:45.595863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c79e-d6d9-4304-a11b-1540e81755b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:45.606130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c79e-d6d9-4304-a11b-1540e81755b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:45.606130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c79e-d6d9-4304-a11b-1540e81755b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:45.606962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c79e-d6d9-4304-a11b-1540e81755b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:18:45.607274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c79e-d6d9-4304-a11b-1540e81755b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:45.608952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c79e-d6d9-4304-a11b-1540e81755b8 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:45.628038 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1074/2162] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:18:45.628186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a603e4-4333-4f2c-aad4-88b8094656de None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:45.645432 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a603e4-4333-4f2c-aad4-88b8094656de None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:45.651566 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8bbdf-c86b-43c4-974d-79b7bb5dfa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:45.652254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8bbdf-c86b-43c4-974d-79b7bb5dfa41 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:45.652532 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8bbdf-c86b-43c4-974d-79b7bb5dfa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:45.652802 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8bbdf-c86b-43c4-974d-79b7bb5dfa41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:45.653539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8bbdf-c86b-43c4-974d-79b7bb5dfa41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:45.655511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8bbdf-c86b-43c4-974d-79b7bb5dfa41 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:45.732981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1089/2163] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:18:45 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:45.737505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c79e-d6d9-4304-a11b-1540e81755b8 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:45.749607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c79e-d6d9-4304-a11b-1540e81755b8 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:45.761181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5696a-331d-48b3-a537-8cd2ac0fd1fc None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:45.761458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5696a-331d-48b3-a537-8cd2ac0fd1fc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:45.761729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5696a-331d-48b3-a537-8cd2ac0fd1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:45.766359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:45.815051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:45.821820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2fc5696a-331d-48b3-a537-8cd2ac0fd1fc None None] MFA Rules not processed for user `48ed1f29820f44bdb78f59bce994c840`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:45.824206 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2fc5696a-331d-48b3-a537-8cd2ac0fd1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:45.932343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead360c-0bae-4fdf-87b5-dcbc9db97f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:45.943267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead360c-0bae-4fdf-87b5-dcbc9db97f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:45.943807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead360c-0bae-4fdf-87b5-dcbc9db97f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:45.944395 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead360c-0bae-4fdf-87b5-dcbc9db97f46 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:45.945299 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead360c-0bae-4fdf-87b5-dcbc9db97f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:45.947996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead360c-0bae-4fdf-87b5-dcbc9db97f46 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:46.000292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1075/2164] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:18:45 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:18:46.004365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead360c-0bae-4fdf-87b5-dcbc9db97f46 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:46.027916 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1090/2165] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:46.034218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead360c-0bae-4fdf-87b5-dcbc9db97f46 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:46.042970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc1944-a910-40fe-9472-08ce84f47dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:46.049983 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc1944-a910-40fe-9472-08ce84f47dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:46.050363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc1944-a910-40fe-9472-08ce84f47dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:46.050641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc1944-a910-40fe-9472-08ce84f47dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:46.051534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc1944-a910-40fe-9472-08ce84f47dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:46.053189 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc1944-a910-40fe-9472-08ce84f47dcd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:46.056357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5696a-331d-48b3-a537-8cd2ac0fd1fc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:46.067181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2fc5696a-331d-48b3-a537-8cd2ac0fd1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:46.092994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1076/2166] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:46.108044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc1944-a910-40fe-9472-08ce84f47dcd admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:46.143467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc1944-a910-40fe-9472-08ce84f47dcd admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:46.156748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacce55-551e-47cc-8b51-c85075c71659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:46.157658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacce55-551e-47cc-8b51-c85075c71659 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:46.157937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacce55-551e-47cc-8b51-c85075c71659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:46.158206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacce55-551e-47cc-8b51-c85075c71659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:46.165338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacce55-551e-47cc-8b51-c85075c71659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:46.168551 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacce55-551e-47cc-8b51-c85075c71659 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:46.190168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5696a-331d-48b3-a537-8cd2ac0fd1fc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:46.196986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f68e3-998f-45c1-a900-6ea2686c7b32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:46.197273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f68e3-998f-45c1-a900-6ea2686c7b32 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:46.197549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f68e3-998f-45c1-a900-6ea2686c7b32 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:46.197823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f68e3-998f-45c1-a900-6ea2686c7b32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:46.202973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1077/2167] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:18:46.203992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacce55-551e-47cc-8b51-c85075c71659 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:46.217285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f68e3-998f-45c1-a900-6ea2686c7b32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:46.218213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f68e3-998f-45c1-a900-6ea2686c7b32 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:46.222522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacce55-551e-47cc-8b51-c85075c71659 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:46.232253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155db2c-c855-430e-aaf5-2953ad60ad8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:46.233363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155db2c-c855-430e-aaf5-2953ad60ad8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:46.233575 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155db2c-c855-430e-aaf5-2953ad60ad8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:46.234348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155db2c-c855-430e-aaf5-2953ad60ad8d admin admin] PATH_INFO: `/v3/projects/9c14ce8983c94eb285ca52a608f3bd93/users/300d8c0fa64a43c28b967093740fac63/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:46.236455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1091/2168] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:18:46.257699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155db2c-c855-430e-aaf5-2953ad60ad8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c14ce8983c94eb285ca52a608f3bd93, user_id=300d8c0fa64a43c28b967093740fac63, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:46.261331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155db2c-c855-430e-aaf5-2953ad60ad8d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:46.280141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1078/2169] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:18:46 2022] PUT /identity/v3/projects/9c14ce8983c94eb285ca52a608f3bd93/users/300d8c0fa64a43c28b967093740fac63/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:18:46.291649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02758c10-f2ee-4958-977d-d6c4ee84f9ed None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:46.292209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02758c10-f2ee-4958-977d-d6c4ee84f9ed None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:46.292487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02758c10-f2ee-4958-977d-d6c4ee84f9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:46.342352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-02758c10-f2ee-4958-977d-d6c4ee84f9ed None None] MFA Rules not processed for user `300d8c0fa64a43c28b967093740fac63`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:46.343767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-02758c10-f2ee-4958-977d-d6c4ee84f9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:46.434973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1092/2170] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:18:46.449301 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155db2c-c855-430e-aaf5-2953ad60ad8d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:46.452438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d155db2c-c855-430e-aaf5-2953ad60ad8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:46.608892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155db2c-c855-430e-aaf5-2953ad60ad8d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:46.615456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff3fdb-6887-4b2d-a7e4-e1c4658056f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70604923ae0b4a4dae21de1314cddbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:46.616150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff3fdb-6887-4b2d-a7e4-e1c4658056f5 service glance] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:46.616795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff3fdb-6887-4b2d-a7e4-e1c4658056f5 service glance] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:46.616795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff3fdb-6887-4b2d-a7e4-e1c4658056f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:46.633631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff3fdb-6887-4b2d-a7e4-e1c4658056f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:46.635627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff3fdb-6887-4b2d-a7e4-e1c4658056f5 service glance] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:46.654441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1079/2171] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:47.664075 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3c817-e903-4546-81aa-e845597b9ab1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:47.665818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3c817-e903-4546-81aa-e845597b9ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:47.666465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3c817-e903-4546-81aa-e845597b9ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:47.714321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-bba3c817-e903-4546-81aa-e845597b9ab1 None None] MFA Rules not processed for user `b4bfd7fbb9964920bdd5ceefc88f8609`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:47.725945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bba3c817-e903-4546-81aa-e845597b9ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:47.733945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:47.874224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1093/2172] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:47.889416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff3fdb-6887-4b2d-a7e4-e1c4658056f5 service glance] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:18:47.891604 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-34ff3fdb-6887-4b2d-a7e4-e1c4658056f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:47.986249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:48.027070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff3fdb-6887-4b2d-a7e4-e1c4658056f5 service glance] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:18:48.044304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe0cda-3956-46a0-847a-343027e8b85c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:18:48.045691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe0cda-3956-46a0-847a-343027e8b85c service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:48.050144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe0cda-3956-46a0-847a-343027e8b85c service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:48.051190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe0cda-3956-46a0-847a-343027e8b85c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:48.055858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-54fe0cda-3956-46a0-847a-343027e8b85c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:48.181765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe0cda-3956-46a0-847a-343027e8b85c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:18:48.183545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe0cda-3956-46a0-847a-343027e8b85c service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:18:48.205991 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1080/2173] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:18:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:18:48.828426 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec0448-4738-4ffa-a939-6840a827b7e8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:48.830767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec0448-4738-4ffa-a939-6840a827b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:48.831087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec0448-4738-4ffa-a939-6840a827b7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:48.889877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-50ec0448-4738-4ffa-a939-6840a827b7e8 None None] MFA Rules not processed for user `48ed1f29820f44bdb78f59bce994c840`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:48.902887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-50ec0448-4738-4ffa-a939-6840a827b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:49.054261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1094/2174] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:49.983308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5959-bed0-4518-8bba-0b3483260bd2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:18:49.984354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5959-bed0-4518-8bba-0b3483260bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:18:49.984842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5959-bed0-4518-8bba-0b3483260bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:18:50.004244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-bb3c5959-bed0-4518-8bba-0b3483260bd2 None None] MFA Rules not processed for user `11943b3f150a4a2ea29d3a772b93a7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:18:50.005937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bb3c5959-bed0-4518-8bba-0b3483260bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:18:50.023362 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1081/2175] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:18:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:18:59.037216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=51 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:59.998281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=33 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:02.858516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50e918-dbf4-46f0-8c10-1ab0e98b84de None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:02.859000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50e918-dbf4-46f0-8c10-1ab0e98b84de None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:02.859111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50e918-dbf4-46f0-8c10-1ab0e98b84de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:02.880553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2d50e918-dbf4-46f0-8c10-1ab0e98b84de None None] MFA Rules not processed for user `d8733e916d634c0a967ba35261e0c3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:02.881749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2d50e918-dbf4-46f0-8c10-1ab0e98b84de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:02.946322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1095/2176] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:04.949346 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b681435-f21c-40bc-8a14-44aece512d46 None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:04.949876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b681435-f21c-40bc-8a14-44aece512d46 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:04.949876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b681435-f21c-40bc-8a14-44aece512d46 None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:04.951339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1082/2177] 10.222.0.23 () {54 vars in 921 bytes} [Tue Jun 28 03:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:19:04.966327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7dca4-fe72-4cd4-81d3-e0afaee3ef08 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:04.967318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7dca4-fe72-4cd4-81d3-e0afaee3ef08 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:04.967661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7dca4-fe72-4cd4-81d3-e0afaee3ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:04.989323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-40c7dca4-fe72-4cd4-81d3-e0afaee3ef08 None None] MFA Rules not processed for user `28b8048235c6421eae12ca99f80ed5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:04.990628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-40c7dca4-fe72-4cd4-81d3-e0afaee3ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:05.047692 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b681435-f21c-40bc-8a14-44aece512d46 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:05.050581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6b681435-f21c-40bc-8a14-44aece512d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:05.095598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1096/2178] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Jun 28 03:19:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:05.107931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7dca4-fe72-4cd4-81d3-e0afaee3ef08 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:05.109754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-40c7dca4-fe72-4cd4-81d3-e0afaee3ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:05.122590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7dca4-fe72-4cd4-81d3-e0afaee3ef08 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:05.127899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812be7a-b050-47e1-9d89-da4f5ede1d06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8048235c6421eae12ca99f80ed5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:05.128366 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812be7a-b050-47e1-9d89-da4f5ede1d06 service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:05.128650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812be7a-b050-47e1-9d89-da4f5ede1d06 service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:05.128933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812be7a-b050-47e1-9d89-da4f5ede1d06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:05.129325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b681435-f21c-40bc-8a14-44aece512d46 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:05.133829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:05.134838 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:05.135039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:05.135345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] PATH_INFO: `/v3/users/e476fa46e893493bae01468dc57ccb12` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:05.136616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e476fa46e893493bae01468dc57ccb12)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:05.138617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:05.141457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812be7a-b050-47e1-9d89-da4f5ede1d06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:05.143222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812be7a-b050-47e1-9d89-da4f5ede1d06 service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:05.153512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1097/2179] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:19:05.190535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e476fa46e893493bae01468dc57ccb12'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.191405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e476fa46e893493bae01468dc57ccb12'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.199284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e476fa46e893493bae01468dc57ccb12'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.207426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e476fa46e893493bae01468dc57ccb12'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.219941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e476fa46e893493bae01468dc57ccb12'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.227821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1083/2180] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:19:05 2022] DELETE /identity/v3/users/e476fa46e893493bae01468dc57ccb12 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:05.425448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812be7a-b050-47e1-9d89-da4f5ede1d06 service placement] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:05.439648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812be7a-b050-47e1-9d89-da4f5ede1d06 service placement] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:05.501075 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:05.501952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:05.502224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:05.502557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] PATH_INFO: `/v3/projects/10701fb4212e40ec9231cd2803983cee` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:05.504393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10701fb4212e40ec9231cd2803983cee)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:05.506320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:05.543908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:05.560431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10701fb4212e40ec9231cd2803983cee', 'request_id': 'req-7dab71dc-9186-4be8-a903-2f03d13bb13a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.567692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10701fb4212e40ec9231cd2803983cee', 'request_id': 'req-7dab71dc-9186-4be8-a903-2f03d13bb13a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.576546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10701fb4212e40ec9231cd2803983cee', 'request_id': 'req-7dab71dc-9186-4be8-a903-2f03d13bb13a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.587990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] The token cache is being invalidate because project 10701fb4212e40ec9231cd2803983cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:19:05.588077 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.589090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.590713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1098/2181] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:19:05 2022] DELETE /identity/v3/projects/10701fb4212e40ec9231cd2803983cee => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:05.594702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:05.596330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:05.613454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38028f-e49f-479e-a5b0-838d31a7c776 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:05.679978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207ef7c-b93e-4207-83ea-26560da6c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:05.680901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207ef7c-b93e-4207-83ea-26560da6c532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:05.681172 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207ef7c-b93e-4207-83ea-26560da6c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:05.681440 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207ef7c-b93e-4207-83ea-26560da6c532 admin admin] PATH_INFO: `/v3/users/d50a260b1f6d45fea8a0227228f6e34f` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:05.682680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207ef7c-b93e-4207-83ea-26560da6c532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50a260b1f6d45fea8a0227228f6e34f)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:05.684591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207ef7c-b93e-4207-83ea-26560da6c532 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:05.708737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:05.743372 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6207ef7c-b93e-4207-83ea-26560da6c532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50a260b1f6d45fea8a0227228f6e34f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.744115 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6207ef7c-b93e-4207-83ea-26560da6c532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50a260b1f6d45fea8a0227228f6e34f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.751136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6207ef7c-b93e-4207-83ea-26560da6c532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50a260b1f6d45fea8a0227228f6e34f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.759566 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6207ef7c-b93e-4207-83ea-26560da6c532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50a260b1f6d45fea8a0227228f6e34f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.772107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6207ef7c-b93e-4207-83ea-26560da6c532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50a260b1f6d45fea8a0227228f6e34f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:05.778537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1084/2182] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:19:05 2022] DELETE /identity/v3/users/d50a260b1f6d45fea8a0227228f6e34f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:05.977851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:05.982032 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:05.996202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab71dc-9186-4be8-a903-2f03d13bb13a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:06.076350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:06.077351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.077635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.077999 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] PATH_INFO: `/v3/projects/62b54babccc748878a361398f6ca3461` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.079232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b54babccc748878a361398f6ca3461)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:06.081129 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:06.133837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b54babccc748878a361398f6ca3461', 'request_id': 'req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:06.140224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b54babccc748878a361398f6ca3461', 'request_id': 'req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:06.148114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b54babccc748878a361398f6ca3461', 'request_id': 'req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:06.159589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] The token cache is being invalidate because project 62b54babccc748878a361398f6ca3461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:19:06.159872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:06.160545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-523d6620-0ae9-4ee4-bfe5-f993bf1320ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:06.162371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1099/2183] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:19:05 2022] DELETE /identity/v3/projects/62b54babccc748878a361398f6ca3461 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:06.167364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d31ac-50a1-4409-a02f-5742f7341b99 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.167845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d31ac-50a1-4409-a02f-5742f7341b99 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.167959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d31ac-50a1-4409-a02f-5742f7341b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.186565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-945d31ac-50a1-4409-a02f-5742f7341b99 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:06.187759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-945d31ac-50a1-4409-a02f-5742f7341b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:06.259801 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1085/2184] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:06.267288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731dbc-4a16-427e-ae02-7b338cf3c517 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.267619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731dbc-4a16-427e-ae02-7b338cf3c517 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.268007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731dbc-4a16-427e-ae02-7b338cf3c517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.286556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-63731dbc-4a16-427e-ae02-7b338cf3c517 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:06.287762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-63731dbc-4a16-427e-ae02-7b338cf3c517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:06.297629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1100/2185] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:06.301814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d31ac-50a1-4409-a02f-5742f7341b99 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:06.312967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d31ac-50a1-4409-a02f-5742f7341b99 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:06.318430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d716503-c365-490e-93f9-affc6e2555ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:06.319375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716503-c365-490e-93f9-affc6e2555ea admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.319987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716503-c365-490e-93f9-affc6e2555ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.320282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716503-c365-490e-93f9-affc6e2555ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.321705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d716503-c365-490e-93f9-affc6e2555ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:19:06.321705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d716503-c365-490e-93f9-affc6e2555ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:06.323438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d716503-c365-490e-93f9-affc6e2555ea admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:06.335832 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1086/2186] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:19:06.340439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63731dbc-4a16-427e-ae02-7b338cf3c517 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:06.354801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63731dbc-4a16-427e-ae02-7b338cf3c517 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:06.359791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b320cce-4497-4260-9f2a-7f55837f4241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:06.360466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320cce-4497-4260-9f2a-7f55837f4241 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.360747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320cce-4497-4260-9f2a-7f55837f4241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.361022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b320cce-4497-4260-9f2a-7f55837f4241 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.361808 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b320cce-4497-4260-9f2a-7f55837f4241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:06.364034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b320cce-4497-4260-9f2a-7f55837f4241 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:06.394845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1101/2187] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:19:06 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:19:06.399045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d716503-c365-490e-93f9-affc6e2555ea admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:06.410259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d716503-c365-490e-93f9-affc6e2555ea admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:06.468160 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c443beb-763c-4bb8-9085-630c82c13110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:06.468839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c443beb-763c-4bb8-9085-630c82c13110 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.469109 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c443beb-763c-4bb8-9085-630c82c13110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.469395 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c443beb-763c-4bb8-9085-630c82c13110 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.470058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c443beb-763c-4bb8-9085-630c82c13110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:06.472035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c443beb-763c-4bb8-9085-630c82c13110 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:06.494166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1087/2188] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:19:06 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:19:06.499254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b320cce-4497-4260-9f2a-7f55837f4241 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:06.512181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b320cce-4497-4260-9f2a-7f55837f4241 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:06.517577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc2bc-342e-4268-afae-ca062e329654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:06.518361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc2bc-342e-4268-afae-ca062e329654 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.518662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc2bc-342e-4268-afae-ca062e329654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.518921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc2bc-342e-4268-afae-ca062e329654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.519659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bc2bc-342e-4268-afae-ca062e329654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:06.521293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bc2bc-342e-4268-afae-ca062e329654 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:06.533907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1102/2189] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:19:06.538097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c443beb-763c-4bb8-9085-630c82c13110 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:06.549271 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c443beb-763c-4bb8-9085-630c82c13110 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:06.555191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97ebce-51b4-4b65-b1f4-a23af2b61471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:06.555865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ebce-51b4-4b65-b1f4-a23af2b61471 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.556134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ebce-51b4-4b65-b1f4-a23af2b61471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.556410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ebce-51b4-4b65-b1f4-a23af2b61471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.557124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97ebce-51b4-4b65-b1f4-a23af2b61471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:06.558757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97ebce-51b4-4b65-b1f4-a23af2b61471 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:06.569416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1088/2190] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:19:06.573557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc2bc-342e-4268-afae-ca062e329654 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:06.584514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc2bc-342e-4268-afae-ca062e329654 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:06.590125 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62aac59-2b06-4608-8d1d-0533b2edcde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:06.590963 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aac59-2b06-4608-8d1d-0533b2edcde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.591248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aac59-2b06-4608-8d1d-0533b2edcde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.591515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aac59-2b06-4608-8d1d-0533b2edcde2 admin admin] PATH_INFO: `/v3/projects/d3df46b9188245cba431468193675e09/users/5fcd79d98373464fa35a9ea5e63958bb/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.595255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:06.609888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62aac59-2b06-4608-8d1d-0533b2edcde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3df46b9188245cba431468193675e09, user_id=5fcd79d98373464fa35a9ea5e63958bb, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:06.613099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62aac59-2b06-4608-8d1d-0533b2edcde2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:06.626895 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1103/2191] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:19:06 2022] PUT /identity/v3/projects/d3df46b9188245cba431468193675e09/users/5fcd79d98373464fa35a9ea5e63958bb/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:06.637357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86bfd-86f7-444f-9067-a33c5b2d6457 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.637774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86bfd-86f7-444f-9067-a33c5b2d6457 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.638324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86bfd-86f7-444f-9067-a33c5b2d6457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.646135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:06.669517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-48f86bfd-86f7-444f-9067-a33c5b2d6457 None None] MFA Rules not processed for user `5fcd79d98373464fa35a9ea5e63958bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:06.678035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-48f86bfd-86f7-444f-9067-a33c5b2d6457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:06.740997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1089/2192] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:06.753487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62aac59-2b06-4608-8d1d-0533b2edcde2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:06.755643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d62aac59-2b06-4608-8d1d-0533b2edcde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:06.822220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62aac59-2b06-4608-8d1d-0533b2edcde2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:06.825923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7e7f2-4465-47ce-826d-162590e5c9cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:06.826604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e7f2-4465-47ce-826d-162590e5c9cc service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.826877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e7f2-4465-47ce-826d-162590e5c9cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.827146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e7f2-4465-47ce-826d-162590e5c9cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.835593 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7e7f2-4465-47ce-826d-162590e5c9cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:06.837017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7e7f2-4465-47ce-826d-162590e5c9cc service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:06.845948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1104/2193] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:19:06.871988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f86bfd-86f7-444f-9067-a33c5b2d6457 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:06.944780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f86bfd-86f7-444f-9067-a33c5b2d6457 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:06.949805 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:06.950680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:06.950958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:06.951225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] PATH_INFO: `/v3/users/5fcd79d98373464fa35a9ea5e63958bb` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:06.952487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fcd79d98373464fa35a9ea5e63958bb)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:06.954653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:07.011811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fcd79d98373464fa35a9ea5e63958bb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:07.012447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fcd79d98373464fa35a9ea5e63958bb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:07.019717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fcd79d98373464fa35a9ea5e63958bb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:07.027972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fcd79d98373464fa35a9ea5e63958bb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:07.052017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fcd79d98373464fa35a9ea5e63958bb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:07.062622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1090/2194] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:19:06 2022] DELETE /identity/v3/users/5fcd79d98373464fa35a9ea5e63958bb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:07.064584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f648b7-3671-4088-94c9-c26c7276ab7a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:07.065257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f648b7-3671-4088-94c9-c26c7276ab7a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:07.065531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f648b7-3671-4088-94c9-c26c7276ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:07.083312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a6f648b7-3671-4088-94c9-c26c7276ab7a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:07.084502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a6f648b7-3671-4088-94c9-c26c7276ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:07.145533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1105/2195] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:07.156483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:07.158021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:07.173117 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:07.220070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de0c1a-d478-4530-a076-c40abdd875fe admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:07.225472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd3c6b-c690-4c38-8204-dc14dd07dca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:07.226148 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd3c6b-c690-4c38-8204-dc14dd07dca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:07.226465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd3c6b-c690-4c38-8204-dc14dd07dca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:07.226739 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd3c6b-c690-4c38-8204-dc14dd07dca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:07.237460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd3c6b-c690-4c38-8204-dc14dd07dca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:07.239064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd3c6b-c690-4c38-8204-dc14dd07dca4 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:07.249010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1091/2196] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:19:07.547000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f648b7-3671-4088-94c9-c26c7276ab7a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:07.550109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a6f648b7-3671-4088-94c9-c26c7276ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:07.562529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f648b7-3671-4088-94c9-c26c7276ab7a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:07.567661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:07.568545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:07.568832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:07.569110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] PATH_INFO: `/v3/projects/d3df46b9188245cba431468193675e09` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:07.570342 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3df46b9188245cba431468193675e09)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:07.572275 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:07.623665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3df46b9188245cba431468193675e09', 'request_id': 'req-cb7075b3-0b27-4c40-a38a-bf540be4bc57'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:07.630740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3df46b9188245cba431468193675e09', 'request_id': 'req-cb7075b3-0b27-4c40-a38a-bf540be4bc57'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:07.639411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3df46b9188245cba431468193675e09', 'request_id': 'req-cb7075b3-0b27-4c40-a38a-bf540be4bc57'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:07.650669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] The token cache is being invalidate because project d3df46b9188245cba431468193675e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:19:07.650951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:07.651617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cb7075b3-0b27-4c40-a38a-bf540be4bc57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:07.653193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1106/2197] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:19:07 2022] DELETE /identity/v3/projects/d3df46b9188245cba431468193675e09 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:07.658249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93f469-5b57-46b1-b496-076b837ddfcb None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:07.658620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93f469-5b57-46b1-b496-076b837ddfcb None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:07.658902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93f469-5b57-46b1-b496-076b837ddfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:07.678423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5c93f469-5b57-46b1-b496-076b837ddfcb None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:07.679604 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5c93f469-5b57-46b1-b496-076b837ddfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:07.750740 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1092/2198] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:07.760281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8da63-3d9c-4c0c-b75f-7f4d6d706306 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:07.760521 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8da63-3d9c-4c0c-b75f-7f4d6d706306 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:07.760822 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8da63-3d9c-4c0c-b75f-7f4d6d706306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:07.780697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-0df8da63-3d9c-4c0c-b75f-7f4d6d706306 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:07.781910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0df8da63-3d9c-4c0c-b75f-7f4d6d706306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:07.790860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1107/2199] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:07.795228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93f469-5b57-46b1-b496-076b837ddfcb None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:07.807631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93f469-5b57-46b1-b496-076b837ddfcb None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:07.812362 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c235cf-a6b5-4fcd-acf4-2a5c24493cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:07.813110 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c235cf-a6b5-4fcd-acf4-2a5c24493cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:07.813555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c235cf-a6b5-4fcd-acf4-2a5c24493cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:07.813830 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c235cf-a6b5-4fcd-acf4-2a5c24493cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:07.815009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c235cf-a6b5-4fcd-acf4-2a5c24493cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:19:07.815737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c235cf-a6b5-4fcd-acf4-2a5c24493cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:07.817653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c235cf-a6b5-4fcd-acf4-2a5c24493cf2 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:07.832841 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1093/2200] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:19:07.837855 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8da63-3d9c-4c0c-b75f-7f4d6d706306 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:07.844086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:07.849366 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8da63-3d9c-4c0c-b75f-7f4d6d706306 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:07.856603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf988409-d6dc-41df-a057-22c1fa5510a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:07.857503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988409-d6dc-41df-a057-22c1fa5510a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:07.858063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988409-d6dc-41df-a057-22c1fa5510a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:07.858448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988409-d6dc-41df-a057-22c1fa5510a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:07.859360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf988409-d6dc-41df-a057-22c1fa5510a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:07.861355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf988409-d6dc-41df-a057-22c1fa5510a7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:07.892013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1108/2201] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:19:07 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:19:07.894163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c235cf-a6b5-4fcd-acf4-2a5c24493cf2 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:07.905364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c235cf-a6b5-4fcd-acf4-2a5c24493cf2 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:07.977418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ebd4-2d38-4f5a-9eee-be9be827bdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:07.978103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ebd4-2d38-4f5a-9eee-be9be827bdfa admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:07.978416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ebd4-2d38-4f5a-9eee-be9be827bdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:07.978686 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ebd4-2d38-4f5a-9eee-be9be827bdfa admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:07.979382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9ebd4-2d38-4f5a-9eee-be9be827bdfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:07.981291 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9ebd4-2d38-4f5a-9eee-be9be827bdfa admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:08.001796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1094/2202] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:19:07 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:19:08.005933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf988409-d6dc-41df-a057-22c1fa5510a7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:08.017193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf988409-d6dc-41df-a057-22c1fa5510a7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:08.022114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a3eb5-a35b-4d0b-a583-4db85eec4056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:08.022943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a3eb5-a35b-4d0b-a583-4db85eec4056 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:08.023229 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a3eb5-a35b-4d0b-a583-4db85eec4056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:08.023603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a3eb5-a35b-4d0b-a583-4db85eec4056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:08.024417 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a3eb5-a35b-4d0b-a583-4db85eec4056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:08.026408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a3eb5-a35b-4d0b-a583-4db85eec4056 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:08.046575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1109/2203] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:19:08.049243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ebd4-2d38-4f5a-9eee-be9be827bdfa admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:08.066936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ebd4-2d38-4f5a-9eee-be9be827bdfa admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:08.072538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194e160-f330-4f71-9a2b-5d83e7d4d30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:08.073304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194e160-f330-4f71-9a2b-5d83e7d4d30c admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:08.073616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194e160-f330-4f71-9a2b-5d83e7d4d30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:08.073925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194e160-f330-4f71-9a2b-5d83e7d4d30c admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:08.074746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194e160-f330-4f71-9a2b-5d83e7d4d30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:08.076480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194e160-f330-4f71-9a2b-5d83e7d4d30c admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:08.091695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1095/2204] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:19:08.092898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a3eb5-a35b-4d0b-a583-4db85eec4056 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:08.106698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a3eb5-a35b-4d0b-a583-4db85eec4056 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:08.111746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe637-2732-4cca-9d23-107c0e72396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:08.113081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe637-2732-4cca-9d23-107c0e72396c admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:08.113536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe637-2732-4cca-9d23-107c0e72396c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:08.113959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe637-2732-4cca-9d23-107c0e72396c admin admin] PATH_INFO: `/v3/projects/93e3478aa0a8409a9a228c88aa12a8f9/users/b374a19c9c214f3f802c241b3e409a59/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:08.135552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe637-2732-4cca-9d23-107c0e72396c admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e3478aa0a8409a9a228c88aa12a8f9, user_id=b374a19c9c214f3f802c241b3e409a59, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:08.138451 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe637-2732-4cca-9d23-107c0e72396c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:08.160706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1110/2205] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:19:08 2022] PUT /identity/v3/projects/93e3478aa0a8409a9a228c88aa12a8f9/users/b374a19c9c214f3f802c241b3e409a59/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:08.171285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1271-e22c-4b76-8fc8-472ce9174b68 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:08.171580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1271-e22c-4b76-8fc8-472ce9174b68 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:08.171863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1271-e22c-4b76-8fc8-472ce9174b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:08.231225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-683b1271-e22c-4b76-8fc8-472ce9174b68 None None] MFA Rules not processed for user `b374a19c9c214f3f802c241b3e409a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:08.232447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-683b1271-e22c-4b76-8fc8-472ce9174b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:08.246930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:08.332075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1096/2206] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:08.344351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe637-2732-4cca-9d23-107c0e72396c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:08.346547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-417fe637-2732-4cca-9d23-107c0e72396c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:08.402549 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe637-2732-4cca-9d23-107c0e72396c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:08.406228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a33f8d-d975-4e4e-aba2-24221c77df4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:08.406922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33f8d-d975-4e4e-aba2-24221c77df4a service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:08.407207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33f8d-d975-4e4e-aba2-24221c77df4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:08.407483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33f8d-d975-4e4e-aba2-24221c77df4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:08.416236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a33f8d-d975-4e4e-aba2-24221c77df4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:08.417702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a33f8d-d975-4e4e-aba2-24221c77df4a service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:08.427242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1111/2207] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:19:08.460072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1271-e22c-4b76-8fc8-472ce9174b68 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:08.536072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1271-e22c-4b76-8fc8-472ce9174b68 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:08.540587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:08.541479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:08.541773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:08.542038 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] PATH_INFO: `/v3/users/b374a19c9c214f3f802c241b3e409a59` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:08.543269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b374a19c9c214f3f802c241b3e409a59)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:08.545183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:08.593941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b374a19c9c214f3f802c241b3e409a59'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:08.594665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b374a19c9c214f3f802c241b3e409a59'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:08.602916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b374a19c9c214f3f802c241b3e409a59'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:08.611119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b374a19c9c214f3f802c241b3e409a59'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:08.623375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b374a19c9c214f3f802c241b3e409a59'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:08.629730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1097/2208] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:19:08 2022] DELETE /identity/v3/users/b374a19c9c214f3f802c241b3e409a59 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:08.634318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b01b-13b4-4643-9dfb-de9a43285b26 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:08.634631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b01b-13b4-4643-9dfb-de9a43285b26 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:08.634910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b01b-13b4-4643-9dfb-de9a43285b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:08.654697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8003b01b-13b4-4643-9dfb-de9a43285b26 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:08.656086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8003b01b-13b4-4643-9dfb-de9a43285b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:08.715364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1112/2209] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:08.725943 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:08.727400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:08.768715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:08.794585 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de05a02-23f5-4c3b-a1f8-3d10865b2242 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:08.798306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87605482-8e68-4275-b3a5-d3f85181ecbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:08.798977 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87605482-8e68-4275-b3a5-d3f85181ecbb service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:08.799315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87605482-8e68-4275-b3a5-d3f85181ecbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:08.799759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87605482-8e68-4275-b3a5-d3f85181ecbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:08.810160 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87605482-8e68-4275-b3a5-d3f85181ecbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:08.811624 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87605482-8e68-4275-b3a5-d3f85181ecbb service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:08.821424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1098/2210] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:19:09.119428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003b01b-13b4-4643-9dfb-de9a43285b26 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:09.121028 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8003b01b-13b4-4643-9dfb-de9a43285b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:09.135824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003b01b-13b4-4643-9dfb-de9a43285b26 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:09.143789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:09.145315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:09.145815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:09.146319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] PATH_INFO: `/v3/projects/93e3478aa0a8409a9a228c88aa12a8f9` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:09.148158 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e3478aa0a8409a9a228c88aa12a8f9)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:09.150811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:09.198471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:09.201389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e3478aa0a8409a9a228c88aa12a8f9', 'request_id': 'req-e3ea924c-2806-4593-bafd-977e446caf42'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:09.210134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e3478aa0a8409a9a228c88aa12a8f9', 'request_id': 'req-e3ea924c-2806-4593-bafd-977e446caf42'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:09.218660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e3478aa0a8409a9a228c88aa12a8f9', 'request_id': 'req-e3ea924c-2806-4593-bafd-977e446caf42'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:09.231396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] The token cache is being invalidate because project 93e3478aa0a8409a9a228c88aa12a8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:19:09.231681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:09.232343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3ea924c-2806-4593-bafd-977e446caf42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:09.234002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1113/2211] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:19:09 2022] DELETE /identity/v3/projects/93e3478aa0a8409a9a228c88aa12a8f9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:09.239816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff7109-b7fb-4a28-aaa0-ce1c1c71e8ce None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:09.240355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff7109-b7fb-4a28-aaa0-ce1c1c71e8ce None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:09.240355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff7109-b7fb-4a28-aaa0-ce1c1c71e8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:09.259744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5fff7109-b7fb-4a28-aaa0-ce1c1c71e8ce None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:09.261011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5fff7109-b7fb-4a28-aaa0-ce1c1c71e8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:09.333871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1099/2212] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:19:09.341979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34283-9d06-4a80-8981-6bf7abdea91e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:09.342262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34283-9d06-4a80-8981-6bf7abdea91e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:09.342587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34283-9d06-4a80-8981-6bf7abdea91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:09.367188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2fb34283-9d06-4a80-8981-6bf7abdea91e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:09.368407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2fb34283-9d06-4a80-8981-6bf7abdea91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:09.376661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1114/2213] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:09.381072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff7109-b7fb-4a28-aaa0-ce1c1c71e8ce None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:09.391059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff7109-b7fb-4a28-aaa0-ce1c1c71e8ce None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:09.396068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb7a29-5539-45c9-8ca8-95ecbe838069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:09.396739 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7a29-5539-45c9-8ca8-95ecbe838069 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:09.397009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7a29-5539-45c9-8ca8-95ecbe838069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:09.397274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7a29-5539-45c9-8ca8-95ecbe838069 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:09.398071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb7a29-5539-45c9-8ca8-95ecbe838069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:19:09.398357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb7a29-5539-45c9-8ca8-95ecbe838069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:09.399981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb7a29-5539-45c9-8ca8-95ecbe838069 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:09.412478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1100/2214] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:19:09.416874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb34283-9d06-4a80-8981-6bf7abdea91e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:09.426630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb34283-9d06-4a80-8981-6bf7abdea91e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:09.431460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eddcfe-24ef-4f79-8c1d-5ec1043ca4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:09.432134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eddcfe-24ef-4f79-8c1d-5ec1043ca4cb admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:09.432415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eddcfe-24ef-4f79-8c1d-5ec1043ca4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:09.432684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eddcfe-24ef-4f79-8c1d-5ec1043ca4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:09.433378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eddcfe-24ef-4f79-8c1d-5ec1043ca4cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:09.435340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eddcfe-24ef-4f79-8c1d-5ec1043ca4cb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:09.467297 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1115/2215] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:19:09 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:19:09.471616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb7a29-5539-45c9-8ca8-95ecbe838069 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:09.483169 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb7a29-5539-45c9-8ca8-95ecbe838069 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:09.558330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e2925-6b79-420f-a3fb-37150d06f5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:09.559187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e2925-6b79-420f-a3fb-37150d06f5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:09.559434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e2925-6b79-420f-a3fb-37150d06f5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:09.559717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e2925-6b79-420f-a3fb-37150d06f5a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:09.560432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e2925-6b79-420f-a3fb-37150d06f5a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:09.562409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e2925-6b79-420f-a3fb-37150d06f5a5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:09.595200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1101/2216] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:19:09 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:19:09.596903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eddcfe-24ef-4f79-8c1d-5ec1043ca4cb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:09.621595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eddcfe-24ef-4f79-8c1d-5ec1043ca4cb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:09.626361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631982d-8931-4a34-b612-e398f32b31d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:09.627043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631982d-8931-4a34-b612-e398f32b31d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:09.627429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631982d-8931-4a34-b612-e398f32b31d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:09.627713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631982d-8931-4a34-b612-e398f32b31d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:09.628448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631982d-8931-4a34-b612-e398f32b31d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:09.630322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631982d-8931-4a34-b612-e398f32b31d6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:09.643743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1116/2217] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:19:09.648218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e2925-6b79-420f-a3fb-37150d06f5a5 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:09.659711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e2925-6b79-420f-a3fb-37150d06f5a5 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:09.664922 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813a886-20a9-4c6b-a0e5-faef65c19b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:09.665933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813a886-20a9-4c6b-a0e5-faef65c19b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:09.666422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813a886-20a9-4c6b-a0e5-faef65c19b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:09.666842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813a886-20a9-4c6b-a0e5-faef65c19b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:09.667875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813a886-20a9-4c6b-a0e5-faef65c19b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:09.669700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813a886-20a9-4c6b-a0e5-faef65c19b88 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:09.698360 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1102/2218] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:19:09.700733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631982d-8931-4a34-b612-e398f32b31d6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:09.711388 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631982d-8931-4a34-b612-e398f32b31d6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:09.719059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd586d08-b084-4fd7-a27b-bc744b3ef7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:09.720391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd586d08-b084-4fd7-a27b-bc744b3ef7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:09.721097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd586d08-b084-4fd7-a27b-bc744b3ef7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:09.721465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd586d08-b084-4fd7-a27b-bc744b3ef7d7 admin admin] PATH_INFO: `/v3/projects/d553078d0a514762ae382e4b42365fc5/users/7456be1ed17a437baaeca969a7e452f1/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:09.741841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd586d08-b084-4fd7-a27b-bc744b3ef7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d553078d0a514762ae382e4b42365fc5, user_id=7456be1ed17a437baaeca969a7e452f1, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:09.744744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd586d08-b084-4fd7-a27b-bc744b3ef7d7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:09.760341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1117/2219] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:19:09 2022] PUT /identity/v3/projects/d553078d0a514762ae382e4b42365fc5/users/7456be1ed17a437baaeca969a7e452f1/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:09.772095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea90f0-7bab-4a4b-8c6c-235a1e1bd66c None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:09.772449 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea90f0-7bab-4a4b-8c6c-235a1e1bd66c None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:09.772823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea90f0-7bab-4a4b-8c6c-235a1e1bd66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:09.808062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-c4ea90f0-7bab-4a4b-8c6c-235a1e1bd66c None None] MFA Rules not processed for user `7456be1ed17a437baaeca969a7e452f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:09.809374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c4ea90f0-7bab-4a4b-8c6c-235a1e1bd66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:09.890479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:09.940125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1103/2220] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:09.951856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd586d08-b084-4fd7-a27b-bc744b3ef7d7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:09.954568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fd586d08-b084-4fd7-a27b-bc744b3ef7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:10.014361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd586d08-b084-4fd7-a27b-bc744b3ef7d7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:10.026755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfc881-553f-4681-8b42-108819155005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:10.027462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc881-553f-4681-8b42-108819155005 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:10.027744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc881-553f-4681-8b42-108819155005 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:10.028005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc881-553f-4681-8b42-108819155005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:10.040305 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfc881-553f-4681-8b42-108819155005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:10.041853 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfc881-553f-4681-8b42-108819155005 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:10.054706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1118/2221] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:19:16.820609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea90f0-7bab-4a4b-8c6c-235a1e1bd66c None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:16.823406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c4ea90f0-7bab-4a4b-8c6c-235a1e1bd66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:16.897034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea90f0-7bab-4a4b-8c6c-235a1e1bd66c None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:16.902508 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:16.903428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:16.903708 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:16.903979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] PATH_INFO: `/v3/users/300d8c0fa64a43c28b967093740fac63` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:16.905183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=300d8c0fa64a43c28b967093740fac63)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:16.907151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:16.961371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300d8c0fa64a43c28b967093740fac63'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:16.962126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300d8c0fa64a43c28b967093740fac63'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:16.969595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300d8c0fa64a43c28b967093740fac63'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:16.979829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300d8c0fa64a43c28b967093740fac63'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:16.998631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300d8c0fa64a43c28b967093740fac63'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:17.007585 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1104/2222] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:19:16 2022] DELETE /identity/v3/users/300d8c0fa64a43c28b967093740fac63 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:17.010652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f88d9-4683-42cb-83eb-59a4d14e622d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:17.011122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f88d9-4683-42cb-83eb-59a4d14e622d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:17.011246 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f88d9-4683-42cb-83eb-59a4d14e622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:17.033868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a79f88d9-4683-42cb-83eb-59a4d14e622d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:17.035262 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a79f88d9-4683-42cb-83eb-59a4d14e622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:17.139206 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1119/2223] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:17.145881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:17.147564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:17.221084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:17.227809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a479ee-20c0-4601-b5df-00f8c2e58aab admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:17.232085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead9788-f4b2-4ab5-a957-350acdd55e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:17.233060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead9788-f4b2-4ab5-a957-350acdd55e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:17.233444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead9788-f4b2-4ab5-a957-350acdd55e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:17.233822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead9788-f4b2-4ab5-a957-350acdd55e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:17.248049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead9788-f4b2-4ab5-a957-350acdd55e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:17.249596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead9788-f4b2-4ab5-a957-350acdd55e02 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:17.278102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1105/2224] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:19:17.613822 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f88d9-4683-42cb-83eb-59a4d14e622d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:17.615313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a79f88d9-4683-42cb-83eb-59a4d14e622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:17.638601 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f88d9-4683-42cb-83eb-59a4d14e622d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:17.647460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:17.648644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:17.649115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:17.649311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] PATH_INFO: `/v3/projects/9c14ce8983c94eb285ca52a608f3bd93` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:17.651043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c14ce8983c94eb285ca52a608f3bd93)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:17.653616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:17.669494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:17.719309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c14ce8983c94eb285ca52a608f3bd93', 'request_id': 'req-40dc307d-5f8b-4b99-9ae8-867408575dc3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:17.727528 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c14ce8983c94eb285ca52a608f3bd93', 'request_id': 'req-40dc307d-5f8b-4b99-9ae8-867408575dc3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:17.737190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c14ce8983c94eb285ca52a608f3bd93', 'request_id': 'req-40dc307d-5f8b-4b99-9ae8-867408575dc3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:17.750381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] The token cache is being invalidate because project 9c14ce8983c94eb285ca52a608f3bd93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:19:17.758481 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:17.759800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-40dc307d-5f8b-4b99-9ae8-867408575dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:17.762331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1120/2225] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:19:17 2022] DELETE /identity/v3/projects/9c14ce8983c94eb285ca52a608f3bd93 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:19.080796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead9788-f4b2-4ab5-a957-350acdd55e02 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:19.082326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9ead9788-f4b2-4ab5-a957-350acdd55e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:19.096447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead9788-f4b2-4ab5-a957-350acdd55e02 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:19.164598 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:19.165534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:19.165819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:19.166103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] PATH_INFO: `/v3/users/7a2df150d0c64a00a264e5a582037f94` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:19.167352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2df150d0c64a00a264e5a582037f94)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:19.169378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:19.230316 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2df150d0c64a00a264e5a582037f94'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:19.230961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2df150d0c64a00a264e5a582037f94'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:19.240408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2df150d0c64a00a264e5a582037f94'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:19.253118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2df150d0c64a00a264e5a582037f94'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:19.273511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2df150d0c64a00a264e5a582037f94'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:19.281112 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1106/2226] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:19:19 2022] DELETE /identity/v3/users/7a2df150d0c64a00a264e5a582037f94 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:19.285659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80298e-32f8-4545-86bb-eb7ea4190692 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:19.286185 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80298e-32f8-4545-86bb-eb7ea4190692 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:19.287715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80298e-32f8-4545-86bb-eb7ea4190692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:19.309334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ab80298e-32f8-4545-86bb-eb7ea4190692 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:19.310607 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ab80298e-32f8-4545-86bb-eb7ea4190692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:19.398765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1121/2227] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:19.407196 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:19.412823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:19.500762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569c4e2-1143-4d30-871f-4eca68a6113c admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:19.504954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d19ea-c0ee-4381-9f0a-60c1449ed13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:19.505631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d19ea-c0ee-4381-9f0a-60c1449ed13f service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:19.505916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d19ea-c0ee-4381-9f0a-60c1449ed13f service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:19.506202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d19ea-c0ee-4381-9f0a-60c1449ed13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:19.518254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d19ea-c0ee-4381-9f0a-60c1449ed13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:19.519954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d19ea-c0ee-4381-9f0a-60c1449ed13f service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:19.531606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1107/2228] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:19:20.175128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80298e-32f8-4545-86bb-eb7ea4190692 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:20.177734 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ab80298e-32f8-4545-86bb-eb7ea4190692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:20.193871 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80298e-32f8-4545-86bb-eb7ea4190692 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:20.200974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:20.202141 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.203203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.203479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] PATH_INFO: `/v3/projects/8eac8c53196c4c20a6ae1c875be1af90` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.204911 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eac8c53196c4c20a6ae1c875be1af90)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:20.207627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:20.283881 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eac8c53196c4c20a6ae1c875be1af90', 'request_id': 'req-f01a50b9-45ff-46e6-a93a-c732ead954d1'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:20.291209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eac8c53196c4c20a6ae1c875be1af90', 'request_id': 'req-f01a50b9-45ff-46e6-a93a-c732ead954d1'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:20.304020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eac8c53196c4c20a6ae1c875be1af90', 'request_id': 'req-f01a50b9-45ff-46e6-a93a-c732ead954d1'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:20.317914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] The token cache is being invalidate because project 8eac8c53196c4c20a6ae1c875be1af90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:19:20.318193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:20.318909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f01a50b9-45ff-46e6-a93a-c732ead954d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:20.323754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1122/2229] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:19:20 2022] DELETE /identity/v3/projects/8eac8c53196c4c20a6ae1c875be1af90 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:19:20.325634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17df3-5b8e-41db-8f77-1f2de230bfb1 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.326120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17df3-5b8e-41db-8f77-1f2de230bfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.326204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17df3-5b8e-41db-8f77-1f2de230bfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.345294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-9aa17df3-5b8e-41db-8f77-1f2de230bfb1 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:20.346549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9aa17df3-5b8e-41db-8f77-1f2de230bfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:20.356824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:20.428228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1108/2230] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:20.437373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b692b4-ff97-4450-a38b-4ea1d3a1044a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.437581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b692b4-ff97-4450-a38b-4ea1d3a1044a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.437789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b692b4-ff97-4450-a38b-4ea1d3a1044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.456477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-25b692b4-ff97-4450-a38b-4ea1d3a1044a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:20.457728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-25b692b4-ff97-4450-a38b-4ea1d3a1044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:20.466150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1123/2231] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:19:20.470284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa17df3-5b8e-41db-8f77-1f2de230bfb1 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:20.482002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa17df3-5b8e-41db-8f77-1f2de230bfb1 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:20.488065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285ad19-096e-4c8a-b228-774d32ca7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:20.488874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ad19-096e-4c8a-b228-774d32ca7e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.489143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ad19-096e-4c8a-b228-774d32ca7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.489429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ad19-096e-4c8a-b228-774d32ca7e98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.490434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285ad19-096e-4c8a-b228-774d32ca7e98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:19:20.490546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285ad19-096e-4c8a-b228-774d32ca7e98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:20.492144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285ad19-096e-4c8a-b228-774d32ca7e98 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:20.508668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1109/2232] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:19:20.509791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b692b4-ff97-4450-a38b-4ea1d3a1044a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:20.520018 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b692b4-ff97-4450-a38b-4ea1d3a1044a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:20.524708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa8fea-84c2-42d0-ab75-727fe5bcb1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:20.525377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa8fea-84c2-42d0-ab75-727fe5bcb1db admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.525659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa8fea-84c2-42d0-ab75-727fe5bcb1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.525935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa8fea-84c2-42d0-ab75-727fe5bcb1db admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.526724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa8fea-84c2-42d0-ab75-727fe5bcb1db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:20.528610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa8fea-84c2-42d0-ab75-727fe5bcb1db admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:20.538815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:20.557200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1124/2233] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:19:20 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:19:20.561466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285ad19-096e-4c8a-b228-774d32ca7e98 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:20.571626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285ad19-096e-4c8a-b228-774d32ca7e98 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:20.634760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c08cc5-b7f1-46d8-8d94-027a61c5ee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:20.635465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08cc5-b7f1-46d8-8d94-027a61c5ee1d admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.635749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08cc5-b7f1-46d8-8d94-027a61c5ee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.636024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08cc5-b7f1-46d8-8d94-027a61c5ee1d admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.636737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c08cc5-b7f1-46d8-8d94-027a61c5ee1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:20.638832 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c08cc5-b7f1-46d8-8d94-027a61c5ee1d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:20.662102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1110/2234] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:19:20 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:19:20.668071 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa8fea-84c2-42d0-ab75-727fe5bcb1db admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:20.679680 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa8fea-84c2-42d0-ab75-727fe5bcb1db admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:20.685036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422a565-34df-4e00-b3a6-05f0ca75b29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:20.685714 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422a565-34df-4e00-b3a6-05f0ca75b29d admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.685993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422a565-34df-4e00-b3a6-05f0ca75b29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.686261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422a565-34df-4e00-b3a6-05f0ca75b29d admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.687026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422a565-34df-4e00-b3a6-05f0ca75b29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:20.688693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422a565-34df-4e00-b3a6-05f0ca75b29d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:20.698096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c08cc5-b7f1-46d8-8d94-027a61c5ee1d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:20.699915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-11c08cc5-b7f1-46d8-8d94-027a61c5ee1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:20.700879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1125/2235] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:19:20.704548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422a565-34df-4e00-b3a6-05f0ca75b29d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:20.713198 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c08cc5-b7f1-46d8-8d94-027a61c5ee1d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:20.715246 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422a565-34df-4e00-b3a6-05f0ca75b29d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:20.718837 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2839e-7a0f-4646-b76e-9e1d15c23916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:20.719716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2839e-7a0f-4646-b76e-9e1d15c23916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.719993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2839e-7a0f-4646-b76e-9e1d15c23916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.720250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18fbd6-6d60-44c8-a447-39bbd3074abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:20.720355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2839e-7a0f-4646-b76e-9e1d15c23916 admin admin] PATH_INFO: `/v3/users/7456be1ed17a437baaeca969a7e452f1` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.720910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18fbd6-6d60-44c8-a447-39bbd3074abb admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.721192 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18fbd6-6d60-44c8-a447-39bbd3074abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.721468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18fbd6-6d60-44c8-a447-39bbd3074abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.721558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2839e-7a0f-4646-b76e-9e1d15c23916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7456be1ed17a437baaeca969a7e452f1)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:20.722194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18fbd6-6d60-44c8-a447-39bbd3074abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:20.723981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2839e-7a0f-4646-b76e-9e1d15c23916 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:20.724337 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18fbd6-6d60-44c8-a447-39bbd3074abb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:20.735229 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1126/2236] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:19:20.739361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18fbd6-6d60-44c8-a447-39bbd3074abb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:20.750819 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18fbd6-6d60-44c8-a447-39bbd3074abb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:20.755703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce0a3-08d9-4863-9935-faed41861ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:20.756640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce0a3-08d9-4863-9935-faed41861ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.756920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce0a3-08d9-4863-9935-faed41861ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.757220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce0a3-08d9-4863-9935-faed41861ac8 admin admin] PATH_INFO: `/v3/projects/ab340b2387474cecab7cf129857d5fb9/users/9b66249352c84534a91f55233344582b/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.779577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ce0a3-08d9-4863-9935-faed41861ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab340b2387474cecab7cf129857d5fb9, user_id=9b66249352c84534a91f55233344582b, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:20.782348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ce0a3-08d9-4863-9935-faed41861ac8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:20.788634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-94e2839e-7a0f-4646-b76e-9e1d15c23916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7456be1ed17a437baaeca969a7e452f1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:20.789740 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-94e2839e-7a0f-4646-b76e-9e1d15c23916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7456be1ed17a437baaeca969a7e452f1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:20.804390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-94e2839e-7a0f-4646-b76e-9e1d15c23916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7456be1ed17a437baaeca969a7e452f1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:20.805422 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1127/2237] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:19:20 2022] PUT /identity/v3/projects/ab340b2387474cecab7cf129857d5fb9/users/9b66249352c84534a91f55233344582b/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:20.816210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6967326-df33-4727-b7b6-72450db7aa49 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.816834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6967326-df33-4727-b7b6-72450db7aa49 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.817375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6967326-df33-4727-b7b6-72450db7aa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.818703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-94e2839e-7a0f-4646-b76e-9e1d15c23916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7456be1ed17a437baaeca969a7e452f1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:20.834622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-94e2839e-7a0f-4646-b76e-9e1d15c23916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7456be1ed17a437baaeca969a7e452f1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:20.841956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1111/2238] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:19:20 2022] DELETE /identity/v3/users/7456be1ed17a437baaeca969a7e452f1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:19:20.846041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560691a-f6f9-4560-8cdd-5e00994b8ff3 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:20.846393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560691a-f6f9-4560-8cdd-5e00994b8ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:20.846759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560691a-f6f9-4560-8cdd-5e00994b8ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:20.855070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:20.859450 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c6967326-df33-4727-b7b6-72450db7aa49 None None] MFA Rules not processed for user `9b66249352c84534a91f55233344582b`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:20.860850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c6967326-df33-4727-b7b6-72450db7aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:20.872672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f560691a-f6f9-4560-8cdd-5e00994b8ff3 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:20.874893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f560691a-f6f9-4560-8cdd-5e00994b8ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:20.943438 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1128/2239] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:19:20.956573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6967326-df33-4727-b7b6-72450db7aa49 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:20.958929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c6967326-df33-4727-b7b6-72450db7aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:20.963070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1112/2240] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:19:20.975336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560691a-f6f9-4560-8cdd-5e00994b8ff3 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:20.976718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f560691a-f6f9-4560-8cdd-5e00994b8ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:21.023180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6967326-df33-4727-b7b6-72450db7aa49 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:21.026800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dcbca-5a6b-417d-809d-6f8f563b2de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:21.027464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dcbca-5a6b-417d-809d-6f8f563b2de8 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:21.027742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dcbca-5a6b-417d-809d-6f8f563b2de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:21.028013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dcbca-5a6b-417d-809d-6f8f563b2de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:21.037191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dcbca-5a6b-417d-809d-6f8f563b2de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:21.038838 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dcbca-5a6b-417d-809d-6f8f563b2de8 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:21.047866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560691a-f6f9-4560-8cdd-5e00994b8ff3 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:21.051879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0decb-8647-4aab-9440-e43e15f2437a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:21.052552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0decb-8647-4aab-9440-e43e15f2437a service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:21.052835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0decb-8647-4aab-9440-e43e15f2437a service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:21.053320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0decb-8647-4aab-9440-e43e15f2437a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:21.054577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1129/2241] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:19:21.067282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0decb-8647-4aab-9440-e43e15f2437a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:21.068987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0decb-8647-4aab-9440-e43e15f2437a service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:21.081216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1113/2242] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:19:21.496203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dcbca-5a6b-417d-809d-6f8f563b2de8 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:21.497799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-dc7dcbca-5a6b-417d-809d-6f8f563b2de8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:21.513150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dcbca-5a6b-417d-809d-6f8f563b2de8 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:21.520778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:21.522061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:21.522513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:21.522886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] PATH_INFO: `/v3/projects/d553078d0a514762ae382e4b42365fc5` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:21.524592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d553078d0a514762ae382e4b42365fc5)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:21.527181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:21.570721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:21.590952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd553078d0a514762ae382e4b42365fc5', 'request_id': 'req-22f75ea0-7e7f-42d3-b718-fc9e0292d415'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:21.598870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd553078d0a514762ae382e4b42365fc5', 'request_id': 'req-22f75ea0-7e7f-42d3-b718-fc9e0292d415'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:21.608250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd553078d0a514762ae382e4b42365fc5', 'request_id': 'req-22f75ea0-7e7f-42d3-b718-fc9e0292d415'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:21.620381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] The token cache is being invalidate because project d553078d0a514762ae382e4b42365fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:19:21.620695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:21.621325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-22f75ea0-7e7f-42d3-b718-fc9e0292d415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:21.623118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1130/2243] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:19:21 2022] DELETE /identity/v3/projects/d553078d0a514762ae382e4b42365fc5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:31.076610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=52 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:31.616834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:31.638655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0decb-8647-4aab-9440-e43e15f2437a service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:31.640319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c8d0decb-8647-4aab-9440-e43e15f2437a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:31.655227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0decb-8647-4aab-9440-e43e15f2437a service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:31.717375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:31.718259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:31.718568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:31.718836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] PATH_INFO: `/v3/users/9b66249352c84534a91f55233344582b` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:31.720059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b66249352c84534a91f55233344582b)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:31.722007 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:31.777689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b66249352c84534a91f55233344582b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:31.778627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b66249352c84534a91f55233344582b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:31.789063 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b66249352c84534a91f55233344582b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:31.798045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b66249352c84534a91f55233344582b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:31.812133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b66249352c84534a91f55233344582b'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:31.818363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1114/2244] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:19:31 2022] DELETE /identity/v3/users/9b66249352c84534a91f55233344582b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:31.823519 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6d02-b0eb-4a34-bb11-fb7c26958677 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:31.823800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6d02-b0eb-4a34-bb11-fb7c26958677 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:31.824068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6d02-b0eb-4a34-bb11-fb7c26958677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:31.844036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-501a6d02-b0eb-4a34-bb11-fb7c26958677 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:31.845366 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-501a6d02-b0eb-4a34-bb11-fb7c26958677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:31.912025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1131/2245] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:19:31.925255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:31.926975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:31.991468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec14ad-be64-4f90-a2db-3f8ccd1660dd admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:31.995675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5bfd4-bf2c-49ca-b15e-bdb9ed9f2f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:31.996336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5bfd4-bf2c-49ca-b15e-bdb9ed9f2f2b service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:31.996613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5bfd4-bf2c-49ca-b15e-bdb9ed9f2f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:31.996895 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5bfd4-bf2c-49ca-b15e-bdb9ed9f2f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:32.006668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5bfd4-bf2c-49ca-b15e-bdb9ed9f2f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:32.008294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5bfd4-bf2c-49ca-b15e-bdb9ed9f2f2b service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:32.018564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1115/2246] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:19:32.358956 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a6d02-b0eb-4a34-bb11-fb7c26958677 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:32.360410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-501a6d02-b0eb-4a34-bb11-fb7c26958677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:32.372675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a6d02-b0eb-4a34-bb11-fb7c26958677 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:32.378398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:32.379318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:32.379566 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:32.379904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] PATH_INFO: `/v3/projects/ab340b2387474cecab7cf129857d5fb9` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:32.381166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab340b2387474cecab7cf129857d5fb9)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:32.384145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:32.432261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab340b2387474cecab7cf129857d5fb9', 'request_id': 'req-d6fccdf4-ac8c-46d2-8061-192216f3349a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:32.438454 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab340b2387474cecab7cf129857d5fb9', 'request_id': 'req-d6fccdf4-ac8c-46d2-8061-192216f3349a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:32.447218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab340b2387474cecab7cf129857d5fb9', 'request_id': 'req-d6fccdf4-ac8c-46d2-8061-192216f3349a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:32.457537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] The token cache is being invalidate because project ab340b2387474cecab7cf129857d5fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:19:32.457831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:32.458524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d6fccdf4-ac8c-46d2-8061-192216f3349a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:19:32.460559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1132/2247] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:19:32 2022] DELETE /identity/v3/projects/ab340b2387474cecab7cf129857d5fb9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:32.465370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e72b3-f600-4068-a81d-489285c92e24 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:32.465864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e72b3-f600-4068-a81d-489285c92e24 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:32.465946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e72b3-f600-4068-a81d-489285c92e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:32.484900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-eb7e72b3-f600-4068-a81d-489285c92e24 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:32.486219 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-eb7e72b3-f600-4068-a81d-489285c92e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:32.506205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:32.552204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1116/2248] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:32.560603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d947a0-5ba1-4315-b728-67407b4670bf None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:32.560878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d947a0-5ba1-4315-b728-67407b4670bf None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:32.561153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d947a0-5ba1-4315-b728-67407b4670bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:32.580183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-65d947a0-5ba1-4315-b728-67407b4670bf None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:32.581875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-65d947a0-5ba1-4315-b728-67407b4670bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:32.589441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1133/2249] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:32.594184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e72b3-f600-4068-a81d-489285c92e24 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:32.604774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e72b3-f600-4068-a81d-489285c92e24 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:32.609409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a724f52-e889-4222-b698-69982b825d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:32.610089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a724f52-e889-4222-b698-69982b825d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:32.610403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a724f52-e889-4222-b698-69982b825d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:32.610676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a724f52-e889-4222-b698-69982b825d52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:32.611413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a724f52-e889-4222-b698-69982b825d52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:19:32.611719 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a724f52-e889-4222-b698-69982b825d52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:32.613295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a724f52-e889-4222-b698-69982b825d52 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:32.625478 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1117/2250] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:19:32.629751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d947a0-5ba1-4315-b728-67407b4670bf None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:32.640311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d947a0-5ba1-4315-b728-67407b4670bf None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:32.645797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3568dd0-482b-41d7-baae-cf1f401fe332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:32.646502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568dd0-482b-41d7-baae-cf1f401fe332 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:32.646786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568dd0-482b-41d7-baae-cf1f401fe332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:32.647061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568dd0-482b-41d7-baae-cf1f401fe332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:32.647843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3568dd0-482b-41d7-baae-cf1f401fe332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:32.649794 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3568dd0-482b-41d7-baae-cf1f401fe332 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:32.686676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1134/2251] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:19:32 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:19:32.690887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a724f52-e889-4222-b698-69982b825d52 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:32.702157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a724f52-e889-4222-b698-69982b825d52 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:32.769821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78205a-ef8a-451d-91f4-4b749b8741be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:32.770817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78205a-ef8a-451d-91f4-4b749b8741be admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:32.771182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78205a-ef8a-451d-91f4-4b749b8741be admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:32.771453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78205a-ef8a-451d-91f4-4b749b8741be admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:32.772391 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78205a-ef8a-451d-91f4-4b749b8741be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:32.774558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78205a-ef8a-451d-91f4-4b749b8741be admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:32.799910 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1118/2252] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:19:32 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:19:32.801289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3568dd0-482b-41d7-baae-cf1f401fe332 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:32.812595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3568dd0-482b-41d7-baae-cf1f401fe332 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:32.817950 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24986f2-d5b2-45b2-a2c8-c1e6fbfedea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:32.818646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24986f2-d5b2-45b2-a2c8-c1e6fbfedea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:32.818922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24986f2-d5b2-45b2-a2c8-c1e6fbfedea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:32.819232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24986f2-d5b2-45b2-a2c8-c1e6fbfedea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:32.820231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24986f2-d5b2-45b2-a2c8-c1e6fbfedea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:32.821831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24986f2-d5b2-45b2-a2c8-c1e6fbfedea4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:32.832741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1135/2253] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:19:32.837099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78205a-ef8a-451d-91f4-4b749b8741be admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:32.848227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78205a-ef8a-451d-91f4-4b749b8741be admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:32.853982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0f22f-e4ad-4f83-b3ed-1a6f94b37983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:32.854683 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0f22f-e4ad-4f83-b3ed-1a6f94b37983 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:32.854961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0f22f-e4ad-4f83-b3ed-1a6f94b37983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:32.855230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0f22f-e4ad-4f83-b3ed-1a6f94b37983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:32.855993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0f22f-e4ad-4f83-b3ed-1a6f94b37983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:32.857648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0f22f-e4ad-4f83-b3ed-1a6f94b37983 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:32.868061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1119/2254] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:19:32.872276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24986f2-d5b2-45b2-a2c8-c1e6fbfedea4 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:32.883007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24986f2-d5b2-45b2-a2c8-c1e6fbfedea4 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:32.887694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98fe25-8fe6-4c8a-afbd-a223a31a3dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:32.888598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98fe25-8fe6-4c8a-afbd-a223a31a3dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:32.888873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98fe25-8fe6-4c8a-afbd-a223a31a3dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:32.889149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98fe25-8fe6-4c8a-afbd-a223a31a3dfe admin admin] PATH_INFO: `/v3/projects/8a573692ff904f3abfb94346fddaab74/users/15f7b282d2a04428bfd97db2f4264a46/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:32.904683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98fe25-8fe6-4c8a-afbd-a223a31a3dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a573692ff904f3abfb94346fddaab74, user_id=15f7b282d2a04428bfd97db2f4264a46, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:32.908508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98fe25-8fe6-4c8a-afbd-a223a31a3dfe admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:32.923347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1136/2255] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:19:32 2022] PUT /identity/v3/projects/8a573692ff904f3abfb94346fddaab74/users/15f7b282d2a04428bfd97db2f4264a46/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:32.928558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8c4c-2796-43cd-9ad2-6820903e8f52 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:32.929156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8c4c-2796-43cd-9ad2-6820903e8f52 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:32.929444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8c4c-2796-43cd-9ad2-6820903e8f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:32.948181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-cc5f8c4c-2796-43cd-9ad2-6820903e8f52 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:32.949295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cc5f8c4c-2796-43cd-9ad2-6820903e8f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:33.012833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1120/2256] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:33.022657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98fe25-8fe6-4c8a-afbd-a223a31a3dfe admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:33.024518 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-df98fe25-8fe6-4c8a-afbd-a223a31a3dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:33.048521 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:33.090635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98fe25-8fe6-4c8a-afbd-a223a31a3dfe admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:33.094428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47f41-5c16-4da7-8342-c0b3c8900a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:33.095087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47f41-5c16-4da7-8342-c0b3c8900a2c service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:33.095368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47f41-5c16-4da7-8342-c0b3c8900a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:33.095642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47f41-5c16-4da7-8342-c0b3c8900a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:33.105689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e47f41-5c16-4da7-8342-c0b3c8900a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:33.107186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e47f41-5c16-4da7-8342-c0b3c8900a2c service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:33.117224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1137/2257] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:19:37.894863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227e2ba-b53a-4597-ad92-58818857afdd None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:37.895900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227e2ba-b53a-4597-ad92-58818857afdd None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:37.896370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227e2ba-b53a-4597-ad92-58818857afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:37.937225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6227e2ba-b53a-4597-ad92-58818857afdd None None] MFA Rules not processed for user `72f981c1a18d4460b7400036bb5d2e31`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:37.938405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6227e2ba-b53a-4597-ad92-58818857afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:37.953639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:38.028125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1121/2258] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:38.613397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eecd7-6a44-4fbd-bcc6-0e19a4d239c1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:38.613947 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eecd7-6a44-4fbd-bcc6-0e19a4d239c1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:38.614283 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eecd7-6a44-4fbd-bcc6-0e19a4d239c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:38.662248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-509eecd7-6a44-4fbd-bcc6-0e19a4d239c1 None None] MFA Rules not processed for user `15f7b282d2a04428bfd97db2f4264a46`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:38.663776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-509eecd7-6a44-4fbd-bcc6-0e19a4d239c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:38.752506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1138/2259] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:38.753948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227e2ba-b53a-4597-ad92-58818857afdd None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:38.849233 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227e2ba-b53a-4597-ad92-58818857afdd None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:38.854012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1efaa2-59ae-450e-ad03-68c091baf750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:38.854740 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1efaa2-59ae-450e-ad03-68c091baf750 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:38.855025 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1efaa2-59ae-450e-ad03-68c091baf750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:38.855301 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1efaa2-59ae-450e-ad03-68c091baf750 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:38.856010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1efaa2-59ae-450e-ad03-68c091baf750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:38.858090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1efaa2-59ae-450e-ad03-68c091baf750 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:38.921088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eecd7-6a44-4fbd-bcc6-0e19a4d239c1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:38.941961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1122/2260] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:19:38 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:19:38.943136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eecd7-6a44-4fbd-bcc6-0e19a4d239c1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:39.047954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812347d-3ffa-4267-98a4-dc6496c5ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:39.047954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812347d-3ffa-4267-98a4-dc6496c5ad31 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:39.047954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812347d-3ffa-4267-98a4-dc6496c5ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:39.047954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812347d-3ffa-4267-98a4-dc6496c5ad31 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:39.048398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812347d-3ffa-4267-98a4-dc6496c5ad31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:39.048398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812347d-3ffa-4267-98a4-dc6496c5ad31 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:39.083414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1139/2261] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:19:38 2022] POST /identity/v3/users => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:19:39.087254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1efaa2-59ae-450e-ad03-68c091baf750 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:39.102141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1efaa2-59ae-450e-ad03-68c091baf750 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:39.107830 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d225-204d-40d7-935d-30e3b9673bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:39.108747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d225-204d-40d7-935d-30e3b9673bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:39.109144 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d225-204d-40d7-935d-30e3b9673bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:39.109475 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d225-204d-40d7-935d-30e3b9673bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:39.110672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9d225-204d-40d7-935d-30e3b9673bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:39.112129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9d225-204d-40d7-935d-30e3b9673bdb admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:39.125538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1123/2262] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:19:39.129964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812347d-3ffa-4267-98a4-dc6496c5ad31 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:39.142930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812347d-3ffa-4267-98a4-dc6496c5ad31 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:39.148497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb0dd7-0afa-4cbf-8845-40af87618c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:39.149711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0dd7-0afa-4cbf-8845-40af87618c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:39.150225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0dd7-0afa-4cbf-8845-40af87618c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:39.150560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0dd7-0afa-4cbf-8845-40af87618c54 admin admin] PATH_INFO: `/v3/projects/94e663ebb1e4478ca3bd8b554c390a49/users/e68d24ad7c744bc3b89be0d68174e034/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:39.169779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb0dd7-0afa-4cbf-8845-40af87618c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e663ebb1e4478ca3bd8b554c390a49, user_id=e68d24ad7c744bc3b89be0d68174e034, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:39.173389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb0dd7-0afa-4cbf-8845-40af87618c54 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:39.196863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1140/2263] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:19:39 2022] PUT /identity/v3/projects/94e663ebb1e4478ca3bd8b554c390a49/users/e68d24ad7c744bc3b89be0d68174e034/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:39.201534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d225-204d-40d7-935d-30e3b9673bdb admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:39.213073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d225-204d-40d7-935d-30e3b9673bdb admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:39.281037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d919-d0e2-4d0b-9857-80fbeafb9c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:39.281722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d919-d0e2-4d0b-9857-80fbeafb9c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:39.282016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d919-d0e2-4d0b-9857-80fbeafb9c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:39.282348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d919-d0e2-4d0b-9857-80fbeafb9c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:39.283058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157d919-d0e2-4d0b-9857-80fbeafb9c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:39.284696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157d919-d0e2-4d0b-9857-80fbeafb9c69 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:39.294974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1124/2264] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:19:39.299361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb0dd7-0afa-4cbf-8845-40af87618c54 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:39.309590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb0dd7-0afa-4cbf-8845-40af87618c54 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:39.314083 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a192a3-e887-48f6-8beb-d37580b68595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:39.315014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a192a3-e887-48f6-8beb-d37580b68595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:39.315292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a192a3-e887-48f6-8beb-d37580b68595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:39.315558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a192a3-e887-48f6-8beb-d37580b68595 admin admin] PATH_INFO: `/v3/projects/94e663ebb1e4478ca3bd8b554c390a49/users/e68d24ad7c744bc3b89be0d68174e034/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:39.317532 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a192a3-e887-48f6-8beb-d37580b68595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e663ebb1e4478ca3bd8b554c390a49, user_id=e68d24ad7c744bc3b89be0d68174e034, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:39.320347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a192a3-e887-48f6-8beb-d37580b68595 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:39.330495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1141/2265] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:19:39 2022] PUT /identity/v3/projects/94e663ebb1e4478ca3bd8b554c390a49/users/e68d24ad7c744bc3b89be0d68174e034/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:19:40.460689 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d919-d0e2-4d0b-9857-80fbeafb9c69 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:40.463398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a157d919-d0e2-4d0b-9857-80fbeafb9c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:40.559818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:40.655922 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d919-d0e2-4d0b-9857-80fbeafb9c69 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:40.767176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538dfae-8563-404e-9b7d-c685d799f1c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:40.768105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538dfae-8563-404e-9b7d-c685d799f1c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:40.768496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538dfae-8563-404e-9b7d-c685d799f1c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:40.768873 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538dfae-8563-404e-9b7d-c685d799f1c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:40.771402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d538dfae-8563-404e-9b7d-c685d799f1c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:40.938736 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538dfae-8563-404e-9b7d-c685d799f1c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:40.940121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538dfae-8563-404e-9b7d-c685d799f1c6 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:40.968981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1125/2266] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:19:46.409962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c304e4-3f3a-4d06-9776-923f107cf70e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:46.410456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c304e4-3f3a-4d06-9776-923f107cf70e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:46.410548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c304e4-3f3a-4d06-9776-923f107cf70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:46.422791 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:46.451293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a7c304e4-3f3a-4d06-9776-923f107cf70e None None] MFA Rules not processed for user `e68d24ad7c744bc3b89be0d68174e034`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:46.452511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a7c304e4-3f3a-4d06-9776-923f107cf70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:46.559767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1142/2267] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:46.573648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538dfae-8563-404e-9b7d-c685d799f1c6 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:46.575120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d538dfae-8563-404e-9b7d-c685d799f1c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:46.640138 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538dfae-8563-404e-9b7d-c685d799f1c6 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:46.644268 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b02c1-73c4-45af-bec4-79a77a28afde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70604923ae0b4a4dae21de1314cddbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:46.644937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b02c1-73c4-45af-bec4-79a77a28afde service glance] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:46.645216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b02c1-73c4-45af-bec4-79a77a28afde service glance] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:46.645484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b02c1-73c4-45af-bec4-79a77a28afde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:46.670317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:46.717620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b02c1-73c4-45af-bec4-79a77a28afde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:46.719352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b02c1-73c4-45af-bec4-79a77a28afde service glance] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:46.730766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1126/2268] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:19:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:19:46.871079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0b8f-b510-4673-8888-19107bc83fa8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:46.871602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0b8f-b510-4673-8888-19107bc83fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:46.872026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0b8f-b510-4673-8888-19107bc83fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:46.894678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-665e0b8f-b510-4673-8888-19107bc83fa8 None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:46.896946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-665e0b8f-b510-4673-8888-19107bc83fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:47.026005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1143/2269] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:19:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:47.080967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b02c1-73c4-45af-bec4-79a77a28afde service glance] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:47.082725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-eb8b02c1-73c4-45af-bec4-79a77a28afde service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:47.203131 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b02c1-73c4-45af-bec4-79a77a28afde service glance] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:47.208471 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb07b4b-b4d0-4323-aa36-861a08df52e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:47.209714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07b4b-b4d0-4323-aa36-861a08df52e6 service swift] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:47.211258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07b4b-b4d0-4323-aa36-861a08df52e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:47.211783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb07b4b-b4d0-4323-aa36-861a08df52e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:47.222699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb07b4b-b4d0-4323-aa36-861a08df52e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:47.225078 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb07b4b-b4d0-4323-aa36-861a08df52e6 service swift] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:47.235996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1127/2270] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:19:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:19:56.557739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c6347-05df-4d3a-a9b8-87b5f6303a94 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:56.558392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c6347-05df-4d3a-a9b8-87b5f6303a94 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:56.558392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c6347-05df-4d3a-a9b8-87b5f6303a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:56.577383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-355c6347-05df-4d3a-a9b8-87b5f6303a94 None None] MFA Rules not processed for user `15f7b282d2a04428bfd97db2f4264a46`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:56.578702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-355c6347-05df-4d3a-a9b8-87b5f6303a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:56.585925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1144/2271] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:19:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:57.231390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=49 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:58.739408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04372a-dbca-4ad5-8dcf-da80a6bce63e None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:58.740406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04372a-dbca-4ad5-8dcf-da80a6bce63e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:58.740783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04372a-dbca-4ad5-8dcf-da80a6bce63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:58.772505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-0b04372a-dbca-4ad5-8dcf-da80a6bce63e None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:19:58.773705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-0b04372a-dbca-4ad5-8dcf-da80a6bce63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:19:58.788091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1128/2272] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:19:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:19:58.801754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c6347-05df-4d3a-a9b8-87b5f6303a94 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:19:58.815246 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c6347-05df-4d3a-a9b8-87b5f6303a94 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:19:58.820319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971613-c4a3-4fb7-984b-b3a7c0fbe792 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:19:58.821054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971613-c4a3-4fb7-984b-b3a7c0fbe792 service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:19:58.821401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971613-c4a3-4fb7-984b-b3a7c0fbe792 service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:19:58.821744 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971613-c4a3-4fb7-984b-b3a7c0fbe792 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:19:58.830543 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e971613-c4a3-4fb7-984b-b3a7c0fbe792 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:19:58.832176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e971613-c4a3-4fb7-984b-b3a7c0fbe792 service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:19:58.840759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1145/2273] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:19:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:20:08.782634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=10 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:08.837221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=66 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:24.978847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04372a-dbca-4ad5-8dcf-da80a6bce63e None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:20:24.983457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-0b04372a-dbca-4ad5-8dcf-da80a6bce63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:20:25.096045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04372a-dbca-4ad5-8dcf-da80a6bce63e None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:20:25.101985 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219b3a8-e32b-4fb6-bec0-a1d8a2d3026e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8048235c6421eae12ca99f80ed5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:20:25.102879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219b3a8-e32b-4fb6-bec0-a1d8a2d3026e service placement] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:25.103204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219b3a8-e32b-4fb6-bec0-a1d8a2d3026e service placement] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:25.103578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219b3a8-e32b-4fb6-bec0-a1d8a2d3026e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:25.105485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5219b3a8-e32b-4fb6-bec0-a1d8a2d3026e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:20:25.120031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219b3a8-e32b-4fb6-bec0-a1d8a2d3026e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:20:25.122327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219b3a8-e32b-4fb6-bec0-a1d8a2d3026e service placement] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:20:25.134016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1129/2274] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:20:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:20:25.304340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971613-c4a3-4fb7-984b-b3a7c0fbe792 service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:20:25.316252 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971613-c4a3-4fb7-984b-b3a7c0fbe792 service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:20:25.319952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505524a-7b7d-4594-b1b3-d83263626e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:20:25.320611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505524a-7b7d-4594-b1b3-d83263626e16 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:25.320892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505524a-7b7d-4594-b1b3-d83263626e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:25.321167 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505524a-7b7d-4594-b1b3-d83263626e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:25.331112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505524a-7b7d-4594-b1b3-d83263626e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:20:25.332558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505524a-7b7d-4594-b1b3-d83263626e16 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:20:25.342957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1146/2275] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:20:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:20:35.129622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=41 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:35.338508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=6 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:35.892195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bec2-5a45-4650-8831-417495304e65 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:35.892485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bec2-5a45-4650-8831-417495304e65 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:35.892767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bec2-5a45-4650-8831-417495304e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:35.911235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-9c31bec2-5a45-4650-8831-417495304e65 None None] MFA Rules not processed for user `d8733e916d634c0a967ba35261e0c3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:20:35.912436 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9c31bec2-5a45-4650-8831-417495304e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:20:35.969434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1130/2276] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:20:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:20:42.267222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5e4c8-cb71-4c8a-aea3-e3c1569bb281 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:42.267763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5e4c8-cb71-4c8a-aea3-e3c1569bb281 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:42.267763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5e4c8-cb71-4c8a-aea3-e3c1569bb281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:42.316176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4fa5e4c8-cb71-4c8a-aea3-e3c1569bb281 None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:20:42.317369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4fa5e4c8-cb71-4c8a-aea3-e3c1569bb281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:20:42.335667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1147/2277] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:20:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:20:42.348683 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31bec2-5a45-4650-8831-417495304e65 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:20:42.370053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31bec2-5a45-4650-8831-417495304e65 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:20:42.375461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014d764-6295-43ba-97cf-b7bdca7f5d8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:20:42.376193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014d764-6295-43ba-97cf-b7bdca7f5d8a service swift] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:42.376498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014d764-6295-43ba-97cf-b7bdca7f5d8a service swift] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:42.376766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014d764-6295-43ba-97cf-b7bdca7f5d8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:42.385142 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014d764-6295-43ba-97cf-b7bdca7f5d8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:20:42.386954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014d764-6295-43ba-97cf-b7bdca7f5d8a service swift] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:20:42.395056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1131/2278] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 28 03:20:52.332887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=18 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:52.392852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=35 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:57.180972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da82087-a4e1-44eb-99e6-389d4fafc4e0 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:57.181564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da82087-a4e1-44eb-99e6-389d4fafc4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:57.181564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da82087-a4e1-44eb-99e6-389d4fafc4e0 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:57.182906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1148/2279] 10.222.0.23 () {54 vars in 921 bytes} [Tue Jun 28 03:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:20:57.188801 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846427-bfb5-4245-8da5-e9dc8d79a295 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:57.189266 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846427-bfb5-4245-8da5-e9dc8d79a295 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:57.189923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846427-bfb5-4245-8da5-e9dc8d79a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:57.253732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-4e846427-bfb5-4245-8da5-e9dc8d79a295 None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:20:57.255071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-4e846427-bfb5-4245-8da5-e9dc8d79a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:20:57.333336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1132/2280] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Jun 28 03:20:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:20:57.345358 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da82087-a4e1-44eb-99e6-389d4fafc4e0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:20:57.366411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da82087-a4e1-44eb-99e6-389d4fafc4e0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:20:57.370469 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f3166-c524-46cc-8d3f-8cb1aa330533 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70604923ae0b4a4dae21de1314cddbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:20:57.371127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f3166-c524-46cc-8d3f-8cb1aa330533 service glance] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:57.371414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f3166-c524-46cc-8d3f-8cb1aa330533 service glance] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:57.371694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f3166-c524-46cc-8d3f-8cb1aa330533 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:57.383312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f3166-c524-46cc-8d3f-8cb1aa330533 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:20:57.384852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f3166-c524-46cc-8d3f-8cb1aa330533 service glance] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:20:57.396971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1149/2281] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:20:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:20:57.466264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa864a-bc26-4508-989b-974c63d6c8ed None None] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:57.466724 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa864a-bc26-4508-989b-974c63d6c8ed None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:57.467022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa864a-bc26-4508-989b-974c63d6c8ed None None] PATH_INFO: `/` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:57.468420 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1133/2282] 10.222.0.23 () {54 vars in 921 bytes} [Tue Jun 28 03:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:20:57.473964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fb4f0-f330-4e50-8ad5-d545139bd380 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:57.474249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fb4f0-f330-4e50-8ad5-d545139bd380 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:57.474660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fb4f0-f330-4e50-8ad5-d545139bd380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:57.494023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c69fb4f0-f330-4e50-8ad5-d545139bd380 None None] MFA Rules not processed for user `d7e0632bc12346b38663a0ef97ab1a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:20:57.495265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c69fb4f0-f330-4e50-8ad5-d545139bd380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:20:57.502646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1150/2283] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Jun 28 03:20:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:20:57.514750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa864a-bc26-4508-989b-974c63d6c8ed None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:20:57.532733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa864a-bc26-4508-989b-974c63d6c8ed None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:20:57.536977 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3e144-e23b-498b-82e1-97e80b0c9fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:20:57.537714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e144-e23b-498b-82e1-97e80b0c9fce service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:57.538050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e144-e23b-498b-82e1-97e80b0c9fce service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:57.538406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e144-e23b-498b-82e1-97e80b0c9fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:57.546033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3e144-e23b-498b-82e1-97e80b0c9fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:20:57.547556 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3e144-e23b-498b-82e1-97e80b0c9fce service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:20:57.555870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1134/2284] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:20:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:20:57.647806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ab95e-8d9f-483e-b89f-f143abf5ba11 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:57.648089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ab95e-8d9f-483e-b89f-f143abf5ba11 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:57.648358 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ab95e-8d9f-483e-b89f-f143abf5ba11 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:57.649754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1151/2285] 10.222.0.23 () {54 vars in 921 bytes} [Tue Jun 28 03:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 03:20:57.655628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646572-5d4f-4295-9c85-28d32ef00871 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:57.655990 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646572-5d4f-4295-9c85-28d32ef00871 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:57.656281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646572-5d4f-4295-9c85-28d32ef00871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:57.676108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-69646572-5d4f-4295-9c85-28d32ef00871 None None] MFA Rules not processed for user `b1868e9d8b004c4fb781e532c775428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:20:57.677347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-69646572-5d4f-4295-9c85-28d32ef00871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:20:57.687664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1135/2286] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Jun 28 03:20:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:20:57.698462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ab95e-8d9f-483e-b89f-f143abf5ba11 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:20:57.711117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ab95e-8d9f-483e-b89f-f143abf5ba11 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:20:57.714949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ea971-2112-4b11-a026-ab562737b10f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:20:57.715582 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea971-2112-4b11-a026-ab562737b10f service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:20:57.715858 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea971-2112-4b11-a026-ab562737b10f service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:20:57.716126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea971-2112-4b11-a026-ab562737b10f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:20:57.727042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ea971-2112-4b11-a026-ab562737b10f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:20:57.728478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ea971-2112-4b11-a026-ab562737b10f service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:20:57.739598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1152/2287] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:20:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:21:00.268646 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249356-72f3-42e4-83c8-b0814292cea6 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:21:00.269207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249356-72f3-42e4-83c8-b0814292cea6 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:21:00.269207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249356-72f3-42e4-83c8-b0814292cea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:21:00.290174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-85249356-72f3-42e4-83c8-b0814292cea6 None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:21:00.292078 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-85249356-72f3-42e4-83c8-b0814292cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:21:00.305652 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1136/2288] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:21:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:21:00.318833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ea971-2112-4b11-a026-ab562737b10f service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:21:00.330708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ea971-2112-4b11-a026-ab562737b10f service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:21:00.336420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd038cb-1df8-4ded-b539-c8fe6893c340 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:21:00.337092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd038cb-1df8-4ded-b539-c8fe6893c340 service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:21:00.337379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd038cb-1df8-4ded-b539-c8fe6893c340 service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:21:00.337634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd038cb-1df8-4ded-b539-c8fe6893c340 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:21:00.346343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd038cb-1df8-4ded-b539-c8fe6893c340 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:21:00.348141 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd038cb-1df8-4ded-b539-c8fe6893c340 service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:21:00.356439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1153/2289] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:21:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:21:10.282463 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=62 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:10.353076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=25 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:17.949588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b6070-e0ad-42aa-886b-ee7ba6d7a566 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:21:17.950163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b6070-e0ad-42aa-886b-ee7ba6d7a566 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:21:17.950163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b6070-e0ad-42aa-886b-ee7ba6d7a566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:21:17.969085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-252b6070-e0ad-42aa-886b-ee7ba6d7a566 None None] MFA Rules not processed for user `72f981c1a18d4460b7400036bb5d2e31`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:21:17.970700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-252b6070-e0ad-42aa-886b-ee7ba6d7a566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:21:18.030050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1137/2290] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:21:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:21:19.860682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4140448-64a7-46d2-99d8-fb862ce7d8ea None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:21:19.861239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4140448-64a7-46d2-99d8-fb862ce7d8ea None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:21:19.861239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4140448-64a7-46d2-99d8-fb862ce7d8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:21:19.880534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e4140448-64a7-46d2-99d8-fb862ce7d8ea None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:21:19.881804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e4140448-64a7-46d2-99d8-fb862ce7d8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:21:19.889297 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1154/2291] 10.222.0.23 () {58 vars in 967 bytes} [Tue Jun 28 03:21:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:21:19.902875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b6070-e0ad-42aa-886b-ee7ba6d7a566 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:21:19.914784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b6070-e0ad-42aa-886b-ee7ba6d7a566 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:21:19.919898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475228f-9c8d-4aab-98b5-e7bf768abcdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:21:19.920715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475228f-9c8d-4aab-98b5-e7bf768abcdb service swift] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:21:19.921014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475228f-9c8d-4aab-98b5-e7bf768abcdb service swift] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:21:19.921356 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475228f-9c8d-4aab-98b5-e7bf768abcdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:21:19.930219 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475228f-9c8d-4aab-98b5-e7bf768abcdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:21:19.931948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475228f-9c8d-4aab-98b5-e7bf768abcdb service swift] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:21:19.940194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1138/2292] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:21:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:21:29.875407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:29.937188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=31 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:46.287399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee7773-1f3c-4627-81fc-d5a00305551f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:21:46.287971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee7773-1f3c-4627-81fc-d5a00305551f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:21:46.287971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee7773-1f3c-4627-81fc-d5a00305551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:21:46.306524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b5ee7773-1f3c-4627-81fc-d5a00305551f None None] MFA Rules not processed for user `d8733e916d634c0a967ba35261e0c3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:21:46.307728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b5ee7773-1f3c-4627-81fc-d5a00305551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:21:46.315885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1155/2293] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:21:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:21:56.300908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:57.967293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f10a-72c5-497a-8858-5edac1aaa5f2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:21:57.967880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f10a-72c5-497a-8858-5edac1aaa5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:21:57.967880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f10a-72c5-497a-8858-5edac1aaa5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:21:57.986783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-2959f10a-72c5-497a-8858-5edac1aaa5f2 None None] MFA Rules not processed for user `1dd219b5b23c454c8279169367d23e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:21:57.988068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-2959f10a-72c5-497a-8858-5edac1aaa5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:21:58.049728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1139/2294] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:21:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:08.041576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=25 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:11.533137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cabda-fa58-498b-9fc7-1360fa711cca None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:11.533666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cabda-fa58-498b-9fc7-1360fa711cca None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:11.533666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cabda-fa58-498b-9fc7-1360fa711cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:11.553972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b93cabda-fa58-498b-9fc7-1360fa711cca None None] MFA Rules not processed for user `48ed1f29820f44bdb78f59bce994c840`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:11.555214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b93cabda-fa58-498b-9fc7-1360fa711cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:11.615392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1156/2295] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:15.867222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959f10a-72c5-497a-8858-5edac1aaa5f2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:15.882161 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959f10a-72c5-497a-8858-5edac1aaa5f2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:15.895054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ca39-2004-44e7-842c-8899974912c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:15.895811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ca39-2004-44e7-842c-8899974912c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:15.896163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ca39-2004-44e7-842c-8899974912c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:15.896728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ca39-2004-44e7-842c-8899974912c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:15.900706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e9b5ca39-2004-44e7-842c-8899974912c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:15.919379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5ca39-2004-44e7-842c-8899974912c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:15.920983 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5ca39-2004-44e7-842c-8899974912c0 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:15.938370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1140/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:16.707592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cabda-fa58-498b-9fc7-1360fa711cca None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:16.721594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cabda-fa58-498b-9fc7-1360fa711cca None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:16.725720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4943ed9-315e-48a7-bf24-b724d74da627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:16.726443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4943ed9-315e-48a7-bf24-b724d74da627 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:16.726770 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4943ed9-315e-48a7-bf24-b724d74da627 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:16.727042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4943ed9-315e-48a7-bf24-b724d74da627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:16.728851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d4943ed9-315e-48a7-bf24-b724d74da627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:16.759304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4943ed9-315e-48a7-bf24-b724d74da627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:16.760815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4943ed9-315e-48a7-bf24-b724d74da627 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:16.773692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1157/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:25.929710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=6 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:26.767783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=31 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:33.475111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ca39-2004-44e7-842c-8899974912c0 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:33.483588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ca39-2004-44e7-842c-8899974912c0 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:33.487402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e326f6-60ab-4dc6-8b66-10d3a926b780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:33.488315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e326f6-60ab-4dc6-8b66-10d3a926b780 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:33.488703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e326f6-60ab-4dc6-8b66-10d3a926b780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:33.488978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e326f6-60ab-4dc6-8b66-10d3a926b780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:33.491014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f0e326f6-60ab-4dc6-8b66-10d3a926b780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:33.558518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e326f6-60ab-4dc6-8b66-10d3a926b780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:33.559914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e326f6-60ab-4dc6-8b66-10d3a926b780 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:33.570535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1141/2298] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:37.083474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4943ed9-315e-48a7-bf24-b724d74da627 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:37.085245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d4943ed9-315e-48a7-bf24-b724d74da627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:37.101496 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4943ed9-315e-48a7-bf24-b724d74da627 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:37.105984 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffc32b-1e70-4874-8742-866dae1eb554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:37.106922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc32b-1e70-4874-8742-866dae1eb554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:37.107208 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc32b-1e70-4874-8742-866dae1eb554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:37.107471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc32b-1e70-4874-8742-866dae1eb554 admin admin] PATH_INFO: `/v3/users/72f981c1a18d4460b7400036bb5d2e31` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:37.108695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffc32b-1e70-4874-8742-866dae1eb554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f981c1a18d4460b7400036bb5d2e31)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:37.110862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffc32b-1e70-4874-8742-866dae1eb554 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:37.166049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d4ffc32b-1e70-4874-8742-866dae1eb554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f981c1a18d4460b7400036bb5d2e31'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:37.166715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d4ffc32b-1e70-4874-8742-866dae1eb554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f981c1a18d4460b7400036bb5d2e31'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:37.174758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d4ffc32b-1e70-4874-8742-866dae1eb554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f981c1a18d4460b7400036bb5d2e31'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:37.191465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d4ffc32b-1e70-4874-8742-866dae1eb554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f981c1a18d4460b7400036bb5d2e31'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:37.199704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d4ffc32b-1e70-4874-8742-866dae1eb554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f981c1a18d4460b7400036bb5d2e31'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:37.205963 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1158/2299] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:22:37 2022] DELETE /identity/v3/users/72f981c1a18d4460b7400036bb5d2e31 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:22:37.389530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e326f6-60ab-4dc6-8b66-10d3a926b780 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:37.400671 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e326f6-60ab-4dc6-8b66-10d3a926b780 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:37.460416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:37.461304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:37.461579 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:37.461844 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] PATH_INFO: `/v3/projects/a404fca0ee9d4910b63e8eec7352d36c` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:37.463187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a404fca0ee9d4910b63e8eec7352d36c)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:37.465134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:37.514804 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a404fca0ee9d4910b63e8eec7352d36c', 'request_id': 'req-644cea90-050c-4885-b615-023a3348dcc5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:37.521489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a404fca0ee9d4910b63e8eec7352d36c', 'request_id': 'req-644cea90-050c-4885-b615-023a3348dcc5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:37.529762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a404fca0ee9d4910b63e8eec7352d36c', 'request_id': 'req-644cea90-050c-4885-b615-023a3348dcc5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:37.540494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] The token cache is being invalidate because project a404fca0ee9d4910b63e8eec7352d36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:22:37.540778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:37.541399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-644cea90-050c-4885-b615-023a3348dcc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:37.542999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1142/2300] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:22:37 2022] DELETE /identity/v3/projects/a404fca0ee9d4910b63e8eec7352d36c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:37.548424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8554d26-18a5-4366-90a1-972ca6eb1979 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:37.548714 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8554d26-18a5-4366-90a1-972ca6eb1979 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:37.548994 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8554d26-18a5-4366-90a1-972ca6eb1979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:37.605020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b8554d26-18a5-4366-90a1-972ca6eb1979 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:37.606242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b8554d26-18a5-4366-90a1-972ca6eb1979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:37.681043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1159/2301] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:37.688959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd2848-5cb9-41f6-8a54-1fef90891ce0 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:37.689250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd2848-5cb9-41f6-8a54-1fef90891ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:37.689520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd2848-5cb9-41f6-8a54-1fef90891ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:37.709167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-b2dd2848-5cb9-41f6-8a54-1fef90891ce0 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:37.710443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b2dd2848-5cb9-41f6-8a54-1fef90891ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:37.719550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1143/2302] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:37.723886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8554d26-18a5-4366-90a1-972ca6eb1979 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:37.734326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8554d26-18a5-4366-90a1-972ca6eb1979 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:37.740544 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e0806-5837-4291-af5d-8fe6006cb9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:37.741199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e0806-5837-4291-af5d-8fe6006cb9ee admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:37.741473 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e0806-5837-4291-af5d-8fe6006cb9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:37.741740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e0806-5837-4291-af5d-8fe6006cb9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:37.742491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e0806-5837-4291-af5d-8fe6006cb9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:22:37.742789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e0806-5837-4291-af5d-8fe6006cb9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:37.744393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e0806-5837-4291-af5d-8fe6006cb9ee admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:37.756762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1160/2303] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:22:37.761029 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd2848-5cb9-41f6-8a54-1fef90891ce0 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:37.771059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd2848-5cb9-41f6-8a54-1fef90891ce0 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:37.775937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35658e-f141-47b3-8542-5c6a8b912099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:37.776586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35658e-f141-47b3-8542-5c6a8b912099 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:37.776862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35658e-f141-47b3-8542-5c6a8b912099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:37.777137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35658e-f141-47b3-8542-5c6a8b912099 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:37.777862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35658e-f141-47b3-8542-5c6a8b912099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:37.779814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35658e-f141-47b3-8542-5c6a8b912099 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:37.793775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:37.809044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1144/2304] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:22:37 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:37.813474 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e0806-5837-4291-af5d-8fe6006cb9ee admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:37.824578 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e0806-5837-4291-af5d-8fe6006cb9ee admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:37.860480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:37.895258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc55521-c196-4bf3-9a4c-add3170a017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:37.896026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc55521-c196-4bf3-9a4c-add3170a017a admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:37.896300 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc55521-c196-4bf3-9a4c-add3170a017a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:37.896581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc55521-c196-4bf3-9a4c-add3170a017a admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:37.897298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc55521-c196-4bf3-9a4c-add3170a017a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:37.899434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc55521-c196-4bf3-9a4c-add3170a017a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:37.923931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1161/2305] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:22:37 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:37.929812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35658e-f141-47b3-8542-5c6a8b912099 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:37.940855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35658e-f141-47b3-8542-5c6a8b912099 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:37.946022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dcadf-e176-4e92-972f-d3756b65ce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:37.946732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dcadf-e176-4e92-972f-d3756b65ce53 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:37.947014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dcadf-e176-4e92-972f-d3756b65ce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:37.947286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dcadf-e176-4e92-972f-d3756b65ce53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:37.948021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dcadf-e176-4e92-972f-d3756b65ce53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:37.949633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dcadf-e176-4e92-972f-d3756b65ce53 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:37.960405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1145/2306] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:37.964610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc55521-c196-4bf3-9a4c-add3170a017a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:37.975797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc55521-c196-4bf3-9a4c-add3170a017a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:37.981524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4c2fd-3907-4e21-bea6-801aade617de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:37.982190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4c2fd-3907-4e21-bea6-801aade617de admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:37.982500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4c2fd-3907-4e21-bea6-801aade617de admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:37.982782 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4c2fd-3907-4e21-bea6-801aade617de admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:37.983500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4c2fd-3907-4e21-bea6-801aade617de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:37.985105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4c2fd-3907-4e21-bea6-801aade617de admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:37.995672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1162/2307] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:37.999739 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dcadf-e176-4e92-972f-d3756b65ce53 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:38.010490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dcadf-e176-4e92-972f-d3756b65ce53 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:38.015706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d03589-1d82-4278-a48a-5a851699774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:38.016592 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d03589-1d82-4278-a48a-5a851699774f admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:38.016899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d03589-1d82-4278-a48a-5a851699774f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:38.017170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d03589-1d82-4278-a48a-5a851699774f admin admin] PATH_INFO: `/v3/projects/6178b3c43c1746329c4883983fe95955/users/8d3b2f97378f439592fa2e4d4232ffa0/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:38.035111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d03589-1d82-4278-a48a-5a851699774f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6178b3c43c1746329c4883983fe95955, user_id=8d3b2f97378f439592fa2e4d4232ffa0, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:38.038000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d03589-1d82-4278-a48a-5a851699774f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:38.054698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1146/2308] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:22:37 2022] PUT /identity/v3/projects/6178b3c43c1746329c4883983fe95955/users/8d3b2f97378f439592fa2e4d4232ffa0/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:38.065022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2ad4-0faf-4a9b-a2e0-e6e1368db582 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:38.065312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2ad4-0faf-4a9b-a2e0-e6e1368db582 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:38.065590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2ad4-0faf-4a9b-a2e0-e6e1368db582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:38.095053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-613f2ad4-0faf-4a9b-a2e0-e6e1368db582 None None] MFA Rules not processed for user `8d3b2f97378f439592fa2e4d4232ffa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:38.096319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-613f2ad4-0faf-4a9b-a2e0-e6e1368db582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:38.163689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1163/2309] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:38.168315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d03589-1d82-4278-a48a-5a851699774f admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:38.241162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d03589-1d82-4278-a48a-5a851699774f admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:38.246589 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2946c3-e5eb-4219-8dab-11ae31fa4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:38.247283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2946c3-e5eb-4219-8dab-11ae31fa4bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:38.247566 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2946c3-e5eb-4219-8dab-11ae31fa4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:38.247841 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2946c3-e5eb-4219-8dab-11ae31fa4bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:38.248547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2946c3-e5eb-4219-8dab-11ae31fa4bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:38.250535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2946c3-e5eb-4219-8dab-11ae31fa4bbd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:38.278855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1147/2310] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:22:38 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:38.282866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f2ad4-0faf-4a9b-a2e0-e6e1368db582 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:38.293738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f2ad4-0faf-4a9b-a2e0-e6e1368db582 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:38.350186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f26d6-21a2-4646-81b6-9adc07802673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:38.350906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f26d6-21a2-4646-81b6-9adc07802673 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:38.351183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f26d6-21a2-4646-81b6-9adc07802673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:38.351454 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f26d6-21a2-4646-81b6-9adc07802673 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:38.352158 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f26d6-21a2-4646-81b6-9adc07802673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:38.354099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f26d6-21a2-4646-81b6-9adc07802673 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:38.375136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1164/2311] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:22:38 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:38.379221 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2946c3-e5eb-4219-8dab-11ae31fa4bbd admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:38.390244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2946c3-e5eb-4219-8dab-11ae31fa4bbd admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:38.394937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c04fba-26c4-4a56-9f21-55eb9853c164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:38.395789 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c04fba-26c4-4a56-9f21-55eb9853c164 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:38.396074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c04fba-26c4-4a56-9f21-55eb9853c164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:38.396347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c04fba-26c4-4a56-9f21-55eb9853c164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:38.397084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c04fba-26c4-4a56-9f21-55eb9853c164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:38.398728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c04fba-26c4-4a56-9f21-55eb9853c164 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:38.411266 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1148/2312] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:38.415421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f26d6-21a2-4646-81b6-9adc07802673 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:38.425509 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f26d6-21a2-4646-81b6-9adc07802673 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:38.430480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2055c-6884-49e9-a4c6-803f991a8afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:38.431378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2055c-6884-49e9-a4c6-803f991a8afb admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:38.431658 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2055c-6884-49e9-a4c6-803f991a8afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:38.431937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2055c-6884-49e9-a4c6-803f991a8afb admin admin] PATH_INFO: `/v3/projects/dcc71eed3fba4ec493e54fdb8eeac0ab/users/b9360fa95a304ab6a924c41dae2e17e8/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:38.448715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2055c-6884-49e9-a4c6-803f991a8afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcc71eed3fba4ec493e54fdb8eeac0ab, user_id=b9360fa95a304ab6a924c41dae2e17e8, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:38.451359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2055c-6884-49e9-a4c6-803f991a8afb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:38.467774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1165/2313] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:22:38 2022] PUT /identity/v3/projects/dcc71eed3fba4ec493e54fdb8eeac0ab/users/b9360fa95a304ab6a924c41dae2e17e8/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:38.472206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c04fba-26c4-4a56-9f21-55eb9853c164 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:38.482870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c04fba-26c4-4a56-9f21-55eb9853c164 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:38.562569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5c272-c2da-479c-a560-feeef183d527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:38.563277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5c272-c2da-479c-a560-feeef183d527 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:38.563556 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5c272-c2da-479c-a560-feeef183d527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:38.563827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5c272-c2da-479c-a560-feeef183d527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:38.564568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5c272-c2da-479c-a560-feeef183d527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:38.566182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5c272-c2da-479c-a560-feeef183d527 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:38.581017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1149/2314] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:22:38.582444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2055c-6884-49e9-a4c6-803f991a8afb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:38.594210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2055c-6884-49e9-a4c6-803f991a8afb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:38.599852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12e236-d412-41df-98e5-a9d1b7788520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:38.600844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12e236-d412-41df-98e5-a9d1b7788520 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:38.601231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12e236-d412-41df-98e5-a9d1b7788520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:38.601585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12e236-d412-41df-98e5-a9d1b7788520 admin admin] PATH_INFO: `/v3/projects/dcc71eed3fba4ec493e54fdb8eeac0ab/users/b9360fa95a304ab6a924c41dae2e17e8/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:38.603718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12e236-d412-41df-98e5-a9d1b7788520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcc71eed3fba4ec493e54fdb8eeac0ab, user_id=b9360fa95a304ab6a924c41dae2e17e8, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:38.606491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12e236-d412-41df-98e5-a9d1b7788520 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:38.612479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:38.619132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1166/2315] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:22:38 2022] PUT /identity/v3/projects/dcc71eed3fba4ec493e54fdb8eeac0ab/users/b9360fa95a304ab6a924c41dae2e17e8/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:38.631324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf431c-ced3-4f97-9c48-1fb95153e9f2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:38.631606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf431c-ced3-4f97-9c48-1fb95153e9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:38.631874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf431c-ced3-4f97-9c48-1fb95153e9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:38.659343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-35bf431c-ced3-4f97-9c48-1fb95153e9f2 None None] MFA Rules not processed for user `b9360fa95a304ab6a924c41dae2e17e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:38.660597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-35bf431c-ced3-4f97-9c48-1fb95153e9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:38.680354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:38.780111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1150/2316] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:38.801412 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12e236-d412-41df-98e5-a9d1b7788520 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:38.803827 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fa12e236-d412-41df-98e5-a9d1b7788520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:38.940284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12e236-d412-41df-98e5-a9d1b7788520 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:38.945545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6849d-6be0-4994-86ce-fda38bf54c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:38.946741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6849d-6be0-4994-86ce-fda38bf54c89 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:38.947128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6849d-6be0-4994-86ce-fda38bf54c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:38.948659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6849d-6be0-4994-86ce-fda38bf54c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:38.961846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6849d-6be0-4994-86ce-fda38bf54c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:38.963637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6849d-6be0-4994-86ce-fda38bf54c89 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:38.979609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1167/2317] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:39.404674 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf431c-ced3-4f97-9c48-1fb95153e9f2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:39.415337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf431c-ced3-4f97-9c48-1fb95153e9f2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:39.422640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ab4da-435a-4843-80ed-37644f0c0a2c tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9360fa95a304ab6a924c41dae2e17e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcc71eed3fba4ec493e54fdb8eeac0ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:39.423352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ab4da-435a-4843-80ed-37644f0c0a2c tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:39.423640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ab4da-435a-4843-80ed-37644f0c0a2c tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:39.423925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ab4da-435a-4843-80ed-37644f0c0a2c tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:39.424685 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ab4da-435a-4843-80ed-37644f0c0a2c tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:22:39.424999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ab4da-435a-4843-80ed-37644f0c0a2c tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:39.426737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ab4da-435a-4843-80ed-37644f0c0a2c tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:39.440368 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1151/2318] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:22:39.444492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6849d-6be0-4994-86ce-fda38bf54c89 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:39.454314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6849d-6be0-4994-86ce-fda38bf54c89 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:39.459533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0dae7-ab2b-41cb-b47c-41f4fb12d8ba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9360fa95a304ab6a924c41dae2e17e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcc71eed3fba4ec493e54fdb8eeac0ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:39.460221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0dae7-ab2b-41cb-b47c-41f4fb12d8ba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:39.460504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0dae7-ab2b-41cb-b47c-41f4fb12d8ba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:39.460781 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0dae7-ab2b-41cb-b47c-41f4fb12d8ba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:39.461488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0dae7-ab2b-41cb-b47c-41f4fb12d8ba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:39.463487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0dae7-ab2b-41cb-b47c-41f4fb12d8ba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:39.498127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1168/2319] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:22:39 2022] POST /identity/v3/projects => generated 353 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:39.502176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ab4da-435a-4843-80ed-37644f0c0a2c tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:39.513166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ab4da-435a-4843-80ed-37644f0c0a2c tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:39.580675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33a04b-2166-4063-9ea1-0c9fb44a4cfe tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9360fa95a304ab6a924c41dae2e17e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcc71eed3fba4ec493e54fdb8eeac0ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:39.581496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33a04b-2166-4063-9ea1-0c9fb44a4cfe tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:39.582012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33a04b-2166-4063-9ea1-0c9fb44a4cfe tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:39.582379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33a04b-2166-4063-9ea1-0c9fb44a4cfe tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:39.583489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33a04b-2166-4063-9ea1-0c9fb44a4cfe tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:22:39.584412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33a04b-2166-4063-9ea1-0c9fb44a4cfe tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:39.586095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33a04b-2166-4063-9ea1-0c9fb44a4cfe tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:39.601271 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1152/2320] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:22:39.659176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0dae7-ab2b-41cb-b47c-41f4fb12d8ba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:39.670498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0dae7-ab2b-41cb-b47c-41f4fb12d8ba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:39.676228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9360fa95a304ab6a924c41dae2e17e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcc71eed3fba4ec493e54fdb8eeac0ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:39.677264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:39.677966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:39.677966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] PATH_INFO: `/v3/projects/5b217a9f48b247b5b0eb9837372b0194` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:39.679043 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b217a9f48b247b5b0eb9837372b0194)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:39.680965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:39.735342 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b217a9f48b247b5b0eb9837372b0194', 'request_id': 'req-8710bdcd-b653-41d7-8ac9-910be5ed7cba'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:39.743650 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b217a9f48b247b5b0eb9837372b0194', 'request_id': 'req-8710bdcd-b653-41d7-8ac9-910be5ed7cba'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:39.752046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b217a9f48b247b5b0eb9837372b0194', 'request_id': 'req-8710bdcd-b653-41d7-8ac9-910be5ed7cba'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:39.762761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] The token cache is being invalidate because project 5b217a9f48b247b5b0eb9837372b0194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:22:39.763042 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:39.763680 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8710bdcd-b653-41d7-8ac9-910be5ed7cba tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:39.765506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1169/2321] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:22:39 2022] DELETE /identity/v3/projects/5b217a9f48b247b5b0eb9837372b0194 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:39.959613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33a04b-2166-4063-9ea1-0c9fb44a4cfe tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:39.961403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8d33a04b-2166-4063-9ea1-0c9fb44a4cfe tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:40.028354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33a04b-2166-4063-9ea1-0c9fb44a4cfe tempest-VolumeQuotaClassesTest-2022563271 tempest-VolumeQuotaClassesTest-2022563271-project-admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:40.088796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:40.108384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:40.108702 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:40.108981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:40.109252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] PATH_INFO: `/v3/users/8d3b2f97378f439592fa2e4d4232ffa0` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:40.110482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3b2f97378f439592fa2e4d4232ffa0)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:40.112513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:40.178182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3b2f97378f439592fa2e4d4232ffa0'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.178905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3b2f97378f439592fa2e4d4232ffa0'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.187554 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3b2f97378f439592fa2e4d4232ffa0'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.197643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3b2f97378f439592fa2e4d4232ffa0'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.214956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3b2f97378f439592fa2e4d4232ffa0'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.221735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1153/2322] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:22:39 2022] DELETE /identity/v3/users/8d3b2f97378f439592fa2e4d4232ffa0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:40.226445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33aa9b-5338-483e-b38e-c22aabd88c80 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:40.226757 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33aa9b-5338-483e-b38e-c22aabd88c80 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:40.227041 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33aa9b-5338-483e-b38e-c22aabd88c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:40.250831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8a33aa9b-5338-483e-b38e-c22aabd88c80 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:40.251955 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8a33aa9b-5338-483e-b38e-c22aabd88c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:40.305401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:40.336886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1170/2323] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:40.347102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:40.348927 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:40.411646 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b1ad0-9327-4584-92c9-9fcbc1dd0ef0 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:40.415688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b4301-30d3-4431-9df4-d6c61fa1e4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:40.416341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b4301-30d3-4431-9df4-d6c61fa1e4ce service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:40.416613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b4301-30d3-4431-9df4-d6c61fa1e4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:40.416995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b4301-30d3-4431-9df4-d6c61fa1e4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:40.428299 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b4301-30d3-4431-9df4-d6c61fa1e4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:40.429768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b4301-30d3-4431-9df4-d6c61fa1e4ce service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:40.440973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1154/2324] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:40.716584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33aa9b-5338-483e-b38e-c22aabd88c80 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:40.718405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8a33aa9b-5338-483e-b38e-c22aabd88c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:40.743177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33aa9b-5338-483e-b38e-c22aabd88c80 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:40.748219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:40.749129 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:40.749456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:40.749735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] PATH_INFO: `/v3/projects/6178b3c43c1746329c4883983fe95955` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:40.752386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6178b3c43c1746329c4883983fe95955)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:40.754849 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:40.814441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6178b3c43c1746329c4883983fe95955', 'request_id': 'req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.820638 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6178b3c43c1746329c4883983fe95955', 'request_id': 'req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.829304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6178b3c43c1746329c4883983fe95955', 'request_id': 'req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.841366 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] The token cache is being invalidate because project 6178b3c43c1746329c4883983fe95955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:22:40.841714 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.842406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.846383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1171/2325] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:22:40 2022] DELETE /identity/v3/projects/6178b3c43c1746329c4883983fe95955 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:40.848725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b4301-30d3-4431-9df4-d6c61fa1e4ce service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:40.859295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b4301-30d3-4431-9df4-d6c61fa1e4ce service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:40.923548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d54bf-d418-4dc3-b90a-e6174187967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:40.924641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d54bf-d418-4dc3-b90a-e6174187967d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:40.924995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d54bf-d418-4dc3-b90a-e6174187967d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:40.925271 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d54bf-d418-4dc3-b90a-e6174187967d admin admin] PATH_INFO: `/v3/users/b9360fa95a304ab6a924c41dae2e17e8` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:40.926757 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d54bf-d418-4dc3-b90a-e6174187967d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9360fa95a304ab6a924c41dae2e17e8)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:40.928709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d54bf-d418-4dc3-b90a-e6174187967d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:40.935814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:40.987965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-0a1d54bf-d418-4dc3-b90a-e6174187967d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9360fa95a304ab6a924c41dae2e17e8'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.989650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-0a1d54bf-d418-4dc3-b90a-e6174187967d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9360fa95a304ab6a924c41dae2e17e8'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:40.996765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-0a1d54bf-d418-4dc3-b90a-e6174187967d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9360fa95a304ab6a924c41dae2e17e8'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:41.010131 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-0a1d54bf-d418-4dc3-b90a-e6174187967d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9360fa95a304ab6a924c41dae2e17e8'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:41.031533 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-0a1d54bf-d418-4dc3-b90a-e6174187967d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9360fa95a304ab6a924c41dae2e17e8'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:41.042332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1155/2326] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:22:40 2022] DELETE /identity/v3/users/b9360fa95a304ab6a924c41dae2e17e8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:41.347494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:41.349831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:41.391702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29b3b0-42aa-4e0a-9ae4-c6c2e9bd9d51 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:41.460067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:41.460963 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:41.461244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:41.461513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] PATH_INFO: `/v3/projects/dcc71eed3fba4ec493e54fdb8eeac0ab` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:41.462758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcc71eed3fba4ec493e54fdb8eeac0ab)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:41.464676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:41.515572 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcc71eed3fba4ec493e54fdb8eeac0ab', 'request_id': 'req-b91991b3-4bf9-494b-8ce5-05ac8d92314f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:41.522233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcc71eed3fba4ec493e54fdb8eeac0ab', 'request_id': 'req-b91991b3-4bf9-494b-8ce5-05ac8d92314f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:41.531348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcc71eed3fba4ec493e54fdb8eeac0ab', 'request_id': 'req-b91991b3-4bf9-494b-8ce5-05ac8d92314f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:41.537400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:41.546689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] The token cache is being invalidate because project dcc71eed3fba4ec493e54fdb8eeac0ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:22:41.547333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:41.548449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b91991b3-4bf9-494b-8ce5-05ac8d92314f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:41.550595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1172/2327] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:22:41 2022] DELETE /identity/v3/projects/dcc71eed3fba4ec493e54fdb8eeac0ab => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:41.556628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844f375-143b-426a-81c5-93104b952cd9 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:41.557116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844f375-143b-426a-81c5-93104b952cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:41.557304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844f375-143b-426a-81c5-93104b952cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:41.575823 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5844f375-143b-426a-81c5-93104b952cd9 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:41.576863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5844f375-143b-426a-81c5-93104b952cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:41.637731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1156/2328] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:41.645877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd6e67-630f-4d7d-8b43-fd9fa86a3495 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:41.646167 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd6e67-630f-4d7d-8b43-fd9fa86a3495 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:41.646480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd6e67-630f-4d7d-8b43-fd9fa86a3495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:41.665950 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-90dd6e67-630f-4d7d-8b43-fd9fa86a3495 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:41.667190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-90dd6e67-630f-4d7d-8b43-fd9fa86a3495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:41.676252 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1173/2329] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:41.680983 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844f375-143b-426a-81c5-93104b952cd9 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:41.691953 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844f375-143b-426a-81c5-93104b952cd9 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:41.698272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78187a41-30cf-4536-8a29-df56ddbb4723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:41.698963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78187a41-30cf-4536-8a29-df56ddbb4723 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:41.699238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78187a41-30cf-4536-8a29-df56ddbb4723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:41.699564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78187a41-30cf-4536-8a29-df56ddbb4723 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:41.700253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78187a41-30cf-4536-8a29-df56ddbb4723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:22:41.700551 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78187a41-30cf-4536-8a29-df56ddbb4723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:41.702150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78187a41-30cf-4536-8a29-df56ddbb4723 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:41.715279 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1157/2330] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:22:41.720746 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd6e67-630f-4d7d-8b43-fd9fa86a3495 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:41.730821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd6e67-630f-4d7d-8b43-fd9fa86a3495 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:41.735669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f74400-f36b-4ab0-9541-26434f0d16df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:41.736319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f74400-f36b-4ab0-9541-26434f0d16df admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:41.736592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f74400-f36b-4ab0-9541-26434f0d16df admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:41.736857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f74400-f36b-4ab0-9541-26434f0d16df admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:41.737560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f74400-f36b-4ab0-9541-26434f0d16df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:41.739609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f74400-f36b-4ab0-9541-26434f0d16df admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:41.766073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1174/2331] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:22:41 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:41.770458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78187a41-30cf-4536-8a29-df56ddbb4723 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:41.780735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78187a41-30cf-4536-8a29-df56ddbb4723 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:41.852091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838f0e1-9c1f-4162-939e-87208dd32026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:41.852685 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f0e1-9c1f-4162-939e-87208dd32026 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:41.852966 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f0e1-9c1f-4162-939e-87208dd32026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:41.853251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f0e1-9c1f-4162-939e-87208dd32026 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:41.853937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838f0e1-9c1f-4162-939e-87208dd32026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:41.855878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838f0e1-9c1f-4162-939e-87208dd32026 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:41.878284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1158/2332] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:22:41 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:41.882799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f74400-f36b-4ab0-9541-26434f0d16df admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:41.894390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f74400-f36b-4ab0-9541-26434f0d16df admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:41.900030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba105b5-cab0-45a3-8e24-b0e0a21ed0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:41.900703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba105b5-cab0-45a3-8e24-b0e0a21ed0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:41.900984 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba105b5-cab0-45a3-8e24-b0e0a21ed0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:41.901257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba105b5-cab0-45a3-8e24-b0e0a21ed0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:41.901991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba105b5-cab0-45a3-8e24-b0e0a21ed0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:41.903678 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba105b5-cab0-45a3-8e24-b0e0a21ed0f5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:41.915061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1175/2333] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:41.919177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838f0e1-9c1f-4162-939e-87208dd32026 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:41.924414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:41.930588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838f0e1-9c1f-4162-939e-87208dd32026 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:41.936406 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abec3c-0437-450b-b1b6-00907f32174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:41.937238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abec3c-0437-450b-b1b6-00907f32174b admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:41.937643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abec3c-0437-450b-b1b6-00907f32174b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:41.937965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abec3c-0437-450b-b1b6-00907f32174b admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:41.938998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abec3c-0437-450b-b1b6-00907f32174b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:41.940705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abec3c-0437-450b-b1b6-00907f32174b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:41.951153 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1159/2334] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:41.955401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba105b5-cab0-45a3-8e24-b0e0a21ed0f5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:41.966202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba105b5-cab0-45a3-8e24-b0e0a21ed0f5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:41.972071 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8d18b-bb17-4722-b24b-f65a942838c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:41.972962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d18b-bb17-4722-b24b-f65a942838c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:41.973264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d18b-bb17-4722-b24b-f65a942838c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:41.973538 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d18b-bb17-4722-b24b-f65a942838c3 admin admin] PATH_INFO: `/v3/projects/08387f1228e8458083a83a4af8b42594/users/71c56c90333c4eb48e315ab46a50e140/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:41.995872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8d18b-bb17-4722-b24b-f65a942838c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08387f1228e8458083a83a4af8b42594, user_id=71c56c90333c4eb48e315ab46a50e140, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:42.000118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8d18b-bb17-4722-b24b-f65a942838c3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:42.017346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1176/2335] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:22:41 2022] PUT /identity/v3/projects/08387f1228e8458083a83a4af8b42594/users/71c56c90333c4eb48e315ab46a50e140/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:22:42.027782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df66a5e-a338-4970-a8ae-6fa018d5dc29 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:42.028081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df66a5e-a338-4970-a8ae-6fa018d5dc29 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:42.028419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df66a5e-a338-4970-a8ae-6fa018d5dc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:42.058351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-4df66a5e-a338-4970-a8ae-6fa018d5dc29 None None] MFA Rules not processed for user `71c56c90333c4eb48e315ab46a50e140`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:42.059637 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-4df66a5e-a338-4970-a8ae-6fa018d5dc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:42.138791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1160/2336] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:42.150304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8d18b-bb17-4722-b24b-f65a942838c3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:42.152180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cbd8d18b-bb17-4722-b24b-f65a942838c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:42.210656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8d18b-bb17-4722-b24b-f65a942838c3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:42.214801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fb6f4-8309-4c24-88a8-318154596067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:42.215446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb6f4-8309-4c24-88a8-318154596067 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:42.215720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb6f4-8309-4c24-88a8-318154596067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:42.215992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb6f4-8309-4c24-88a8-318154596067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:42.225190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fb6f4-8309-4c24-88a8-318154596067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:42.226765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fb6f4-8309-4c24-88a8-318154596067 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:42.235436 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1177/2337] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:45.079880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df66a5e-a338-4970-a8ae-6fa018d5dc29 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:45.081348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-4df66a5e-a338-4970-a8ae-6fa018d5dc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:45.174127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df66a5e-a338-4970-a8ae-6fa018d5dc29 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:45.179626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c3687-c620-4e0c-9a45-f5bb6fa72d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:45.180287 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c3687-c620-4e0c-9a45-f5bb6fa72d4f service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:45.180605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c3687-c620-4e0c-9a45-f5bb6fa72d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:45.180840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c3687-c620-4e0c-9a45-f5bb6fa72d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:45.182672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8a7c3687-c620-4e0c-9a45-f5bb6fa72d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:45.243544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c3687-c620-4e0c-9a45-f5bb6fa72d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:45.245222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c3687-c620-4e0c-9a45-f5bb6fa72d4f service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:45.257547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1161/2338] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:47.501421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd95ee1-da61-473e-a619-983e13feb203 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:47.501885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd95ee1-da61-473e-a619-983e13feb203 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:47.501991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd95ee1-da61-473e-a619-983e13feb203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:47.519696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-edd95ee1-da61-473e-a619-983e13feb203 None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:47.520904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-edd95ee1-da61-473e-a619-983e13feb203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:47.584073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1178/2339] 10.222.0.23 () {58 vars in 967 bytes} [Tue Jun 28 03:22:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:47.636204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c3687-c620-4e0c-9a45-f5bb6fa72d4f service nova] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:47.638208 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8a7c3687-c620-4e0c-9a45-f5bb6fa72d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:47.663485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:47.704396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd95ee1-da61-473e-a619-983e13feb203 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:47.726933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c3687-c620-4e0c-9a45-f5bb6fa72d4f service nova] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:47.732362 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe32cb1-c649-4a9e-a7d2-1833a1821df6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:47.733019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe32cb1-c649-4a9e-a7d2-1833a1821df6 service swift] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:47.733297 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe32cb1-c649-4a9e-a7d2-1833a1821df6 service swift] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:47.733571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe32cb1-c649-4a9e-a7d2-1833a1821df6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:47.741591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe32cb1-c649-4a9e-a7d2-1833a1821df6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:47.743206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe32cb1-c649-4a9e-a7d2-1833a1821df6 service swift] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:47.747853 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:47.752135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1162/2340] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:22:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:22:47.770947 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd95ee1-da61-473e-a619-983e13feb203 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:47.775759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:47.776751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:47.776954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:47.777168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] PATH_INFO: `/v3/users/71c56c90333c4eb48e315ab46a50e140` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:47.779021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c56c90333c4eb48e315ab46a50e140)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:47.781034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:47.835525 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c56c90333c4eb48e315ab46a50e140'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:47.836304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c56c90333c4eb48e315ab46a50e140'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:47.845836 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c56c90333c4eb48e315ab46a50e140'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:47.861469 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c56c90333c4eb48e315ab46a50e140'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:47.870512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c56c90333c4eb48e315ab46a50e140'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:47.878102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1179/2341] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:22:47 2022] DELETE /identity/v3/users/71c56c90333c4eb48e315ab46a50e140 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:22:47.882860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d37f8-df76-4d46-89f6-c17d27648a5f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:47.883137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d37f8-df76-4d46-89f6-c17d27648a5f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:47.883411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d37f8-df76-4d46-89f6-c17d27648a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:47.905363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e82d37f8-df76-4d46-89f6-c17d27648a5f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:47.906617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e82d37f8-df76-4d46-89f6-c17d27648a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:47.973182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1163/2342] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:47.983450 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:47.985005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:48.047350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb856994-23bd-4dd3-b580-877d4b2ebdd9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:48.052005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1940ff-6f95-4f16-b0fc-37410611c6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:48.052676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1940ff-6f95-4f16-b0fc-37410611c6fb service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:48.052961 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1940ff-6f95-4f16-b0fc-37410611c6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:48.053261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1940ff-6f95-4f16-b0fc-37410611c6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:48.064902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1940ff-6f95-4f16-b0fc-37410611c6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:48.066428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1940ff-6f95-4f16-b0fc-37410611c6fb service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:48.082228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1180/2343] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:48.391552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d37f8-df76-4d46-89f6-c17d27648a5f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:48.393005 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e82d37f8-df76-4d46-89f6-c17d27648a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:48.405380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d37f8-df76-4d46-89f6-c17d27648a5f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:48.410730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:48.411627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:48.411911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:48.412186 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] PATH_INFO: `/v3/projects/08387f1228e8458083a83a4af8b42594` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:48.413420 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08387f1228e8458083a83a4af8b42594)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:48.415366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:48.476443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08387f1228e8458083a83a4af8b42594', 'request_id': 'req-ad100d27-790a-4235-9ce3-d4690e4c8887'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:48.483500 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08387f1228e8458083a83a4af8b42594', 'request_id': 'req-ad100d27-790a-4235-9ce3-d4690e4c8887'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:48.492678 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08387f1228e8458083a83a4af8b42594', 'request_id': 'req-ad100d27-790a-4235-9ce3-d4690e4c8887'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:48.503995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] The token cache is being invalidate because project 08387f1228e8458083a83a4af8b42594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:22:48.504283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:48.504927 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ad100d27-790a-4235-9ce3-d4690e4c8887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:48.506744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1164/2344] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:22:48 2022] DELETE /identity/v3/projects/08387f1228e8458083a83a4af8b42594 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:48.511553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc720f5-0b48-4fb7-b88e-43bb3c4f7605 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:48.512096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc720f5-0b48-4fb7-b88e-43bb3c4f7605 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:48.512341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc720f5-0b48-4fb7-b88e-43bb3c4f7605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:48.531816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ffc720f5-0b48-4fb7-b88e-43bb3c4f7605 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:48.533244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ffc720f5-0b48-4fb7-b88e-43bb3c4f7605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:48.595941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1181/2345] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:22:48.603796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04756a9d-e1bd-49fe-8199-2a65275db351 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:48.604088 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04756a9d-e1bd-49fe-8199-2a65275db351 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:48.604366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04756a9d-e1bd-49fe-8199-2a65275db351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:48.623765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-04756a9d-e1bd-49fe-8199-2a65275db351 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:48.624994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-04756a9d-e1bd-49fe-8199-2a65275db351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:48.633079 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1165/2346] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:22:48.637761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc720f5-0b48-4fb7-b88e-43bb3c4f7605 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:48.642908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:48.648396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc720f5-0b48-4fb7-b88e-43bb3c4f7605 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:48.655325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbef679-859c-4368-8d9a-9da5cc5af284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:48.656086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbef679-859c-4368-8d9a-9da5cc5af284 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:48.656362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbef679-859c-4368-8d9a-9da5cc5af284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:48.656682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbef679-859c-4368-8d9a-9da5cc5af284 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:48.657418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbef679-859c-4368-8d9a-9da5cc5af284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:22:48.657724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbef679-859c-4368-8d9a-9da5cc5af284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:48.659819 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbef679-859c-4368-8d9a-9da5cc5af284 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:48.672462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1182/2347] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:22:48.676881 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04756a9d-e1bd-49fe-8199-2a65275db351 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:48.686688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04756a9d-e1bd-49fe-8199-2a65275db351 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:48.691514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8679e4-cdb9-4d96-822a-57ad7b02988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:48.692171 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8679e4-cdb9-4d96-822a-57ad7b02988f admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:48.692446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8679e4-cdb9-4d96-822a-57ad7b02988f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:48.692713 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8679e4-cdb9-4d96-822a-57ad7b02988f admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:48.693408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8679e4-cdb9-4d96-822a-57ad7b02988f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:48.695349 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8679e4-cdb9-4d96-822a-57ad7b02988f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:48.705523 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:48.728498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1166/2348] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:22:48 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:48.729655 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbef679-859c-4368-8d9a-9da5cc5af284 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:48.740691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbef679-859c-4368-8d9a-9da5cc5af284 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:48.800404 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b46421-da74-4470-affd-b6c83517587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:48.801086 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46421-da74-4470-affd-b6c83517587f admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:48.801392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46421-da74-4470-affd-b6c83517587f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:48.801660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46421-da74-4470-affd-b6c83517587f admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:48.802378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b46421-da74-4470-affd-b6c83517587f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:48.804325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b46421-da74-4470-affd-b6c83517587f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:48.829566 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1183/2349] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:22:48 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:48.831210 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8679e4-cdb9-4d96-822a-57ad7b02988f admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:48.842211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8679e4-cdb9-4d96-822a-57ad7b02988f admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:48.847558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6127e4a-ffa1-42bc-bcbc-1231f4621151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:48.848247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127e4a-ffa1-42bc-bcbc-1231f4621151 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:48.848506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127e4a-ffa1-42bc-bcbc-1231f4621151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:48.848775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127e4a-ffa1-42bc-bcbc-1231f4621151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:48.849507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6127e4a-ffa1-42bc-bcbc-1231f4621151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:48.851143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6127e4a-ffa1-42bc-bcbc-1231f4621151 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:48.862812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1167/2350] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:22:48.867061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b46421-da74-4470-affd-b6c83517587f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:48.877777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b46421-da74-4470-affd-b6c83517587f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:48.882665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717e003-b7cb-4952-a93b-d5c6d85e3c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:48.883415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e003-b7cb-4952-a93b-d5c6d85e3c28 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:48.883694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e003-b7cb-4952-a93b-d5c6d85e3c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:48.883964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e003-b7cb-4952-a93b-d5c6d85e3c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:48.884684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717e003-b7cb-4952-a93b-d5c6d85e3c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:48.886318 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717e003-b7cb-4952-a93b-d5c6d85e3c28 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:48.897046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1184/2351] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:48.901487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6127e4a-ffa1-42bc-bcbc-1231f4621151 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:48.911987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6127e4a-ffa1-42bc-bcbc-1231f4621151 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:48.917399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a353f45-1b57-4a62-a8c3-da420b831a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:48.918335 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a353f45-1b57-4a62-a8c3-da420b831a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:48.918619 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a353f45-1b57-4a62-a8c3-da420b831a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:48.919132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a353f45-1b57-4a62-a8c3-da420b831a50 admin admin] PATH_INFO: `/v3/projects/5f2d6bd018e740f79f1de9591deac37d/users/797db1020f8f4fa8ae6ff0ea6bcff97a/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:48.935831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a353f45-1b57-4a62-a8c3-da420b831a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2d6bd018e740f79f1de9591deac37d, user_id=797db1020f8f4fa8ae6ff0ea6bcff97a, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:48.938468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a353f45-1b57-4a62-a8c3-da420b831a50 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:48.954123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1168/2352] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:22:48 2022] PUT /identity/v3/projects/5f2d6bd018e740f79f1de9591deac37d/users/797db1020f8f4fa8ae6ff0ea6bcff97a/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:22:48.964539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf852c1c-084b-4c53-b1bf-65101db02d1a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:48.964823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf852c1c-084b-4c53-b1bf-65101db02d1a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:48.965096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf852c1c-084b-4c53-b1bf-65101db02d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:48.992964 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-bf852c1c-084b-4c53-b1bf-65101db02d1a None None] MFA Rules not processed for user `797db1020f8f4fa8ae6ff0ea6bcff97a`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:48.994161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bf852c1c-084b-4c53-b1bf-65101db02d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:49.070818 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1185/2353] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:49.075993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a353f45-1b57-4a62-a8c3-da420b831a50 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:49.160374 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a353f45-1b57-4a62-a8c3-da420b831a50 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:49.165629 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc21e4a-de36-412b-9413-e90d2b6194aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:49.166533 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc21e4a-de36-412b-9413-e90d2b6194aa admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:49.166954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc21e4a-de36-412b-9413-e90d2b6194aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:49.167232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc21e4a-de36-412b-9413-e90d2b6194aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:49.168112 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc21e4a-de36-412b-9413-e90d2b6194aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:49.170580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc21e4a-de36-412b-9413-e90d2b6194aa admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:49.207382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1169/2354] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:22:49 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:49.211694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf852c1c-084b-4c53-b1bf-65101db02d1a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:49.226788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf852c1c-084b-4c53-b1bf-65101db02d1a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:49.298088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:49.305874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f3b4-5dbf-420c-a88b-01fa24562836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:49.307219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f3b4-5dbf-420c-a88b-01fa24562836 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:49.307963 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f3b4-5dbf-420c-a88b-01fa24562836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:49.309186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f3b4-5dbf-420c-a88b-01fa24562836 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:49.309186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535f3b4-5dbf-420c-a88b-01fa24562836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:49.311722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535f3b4-5dbf-420c-a88b-01fa24562836 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:49.349273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1186/2355] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:22:49 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:49.353627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc21e4a-de36-412b-9413-e90d2b6194aa admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:49.365169 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc21e4a-de36-412b-9413-e90d2b6194aa admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:49.371728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a4d08-397a-4a39-bbe1-f7fb8f758f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:49.373102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a4d08-397a-4a39-bbe1-f7fb8f758f52 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:49.373480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a4d08-397a-4a39-bbe1-f7fb8f758f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:49.373840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a4d08-397a-4a39-bbe1-f7fb8f758f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:49.374987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a4d08-397a-4a39-bbe1-f7fb8f758f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:49.377146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a4d08-397a-4a39-bbe1-f7fb8f758f52 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:49.396265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1170/2356] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:49.397734 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f3b4-5dbf-420c-a88b-01fa24562836 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:49.411974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f3b4-5dbf-420c-a88b-01fa24562836 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:49.418420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70732a-1293-4df9-a0e2-adf336b0d59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:49.419507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70732a-1293-4df9-a0e2-adf336b0d59a admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:49.419954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70732a-1293-4df9-a0e2-adf336b0d59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:49.420137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70732a-1293-4df9-a0e2-adf336b0d59a admin admin] PATH_INFO: `/v3/projects/2b70a58529c44665b40162e058ec4f36/users/b38b2d8e2bec40b18480c38ff3753373/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:49.440686 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70732a-1293-4df9-a0e2-adf336b0d59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b70a58529c44665b40162e058ec4f36, user_id=b38b2d8e2bec40b18480c38ff3753373, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:49.443430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70732a-1293-4df9-a0e2-adf336b0d59a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:49.461705 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1187/2357] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:22:49 2022] PUT /identity/v3/projects/2b70a58529c44665b40162e058ec4f36/users/b38b2d8e2bec40b18480c38ff3753373/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:49.462959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a4d08-397a-4a39-bbe1-f7fb8f758f52 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:49.474656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a4d08-397a-4a39-bbe1-f7fb8f758f52 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:49.544557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676696c6-56e0-42cb-8cfb-07a080a7087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:49.545912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676696c6-56e0-42cb-8cfb-07a080a7087a admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:49.546261 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676696c6-56e0-42cb-8cfb-07a080a7087a admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:49.546595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676696c6-56e0-42cb-8cfb-07a080a7087a admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:49.547474 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676696c6-56e0-42cb-8cfb-07a080a7087a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:49.549934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676696c6-56e0-42cb-8cfb-07a080a7087a admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:49.566640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1171/2358] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:49.567698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70732a-1293-4df9-a0e2-adf336b0d59a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:49.580515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70732a-1293-4df9-a0e2-adf336b0d59a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:49.586853 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c8677-b2c2-4812-9368-5319f7532663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:49.588136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8677-b2c2-4812-9368-5319f7532663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:49.588408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8677-b2c2-4812-9368-5319f7532663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:49.588679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8677-b2c2-4812-9368-5319f7532663 admin admin] PATH_INFO: `/v3/projects/2b70a58529c44665b40162e058ec4f36/users/b38b2d8e2bec40b18480c38ff3753373/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:49.592034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c8677-b2c2-4812-9368-5319f7532663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b70a58529c44665b40162e058ec4f36, user_id=b38b2d8e2bec40b18480c38ff3753373, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:49.595212 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c8677-b2c2-4812-9368-5319f7532663 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:49.620410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1188/2359] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:22:49 2022] PUT /identity/v3/projects/2b70a58529c44665b40162e058ec4f36/users/b38b2d8e2bec40b18480c38ff3753373/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:22:49.629283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20fb61-e04f-44e3-aa34-cb0c4feb5a7b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:49.629568 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20fb61-e04f-44e3-aa34-cb0c4feb5a7b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:49.629840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20fb61-e04f-44e3-aa34-cb0c4feb5a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:49.659399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7d20fb61-e04f-44e3-aa34-cb0c4feb5a7b None None] MFA Rules not processed for user `b38b2d8e2bec40b18480c38ff3753373`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:49.660716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7d20fb61-e04f-44e3-aa34-cb0c4feb5a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:49.675152 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:49.752765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1172/2360] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:49.764155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c8677-b2c2-4812-9368-5319f7532663 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:49.765903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-aa4c8677-b2c2-4812-9368-5319f7532663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:49.832057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c8677-b2c2-4812-9368-5319f7532663 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:49.836426 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc700c-f559-4d98-a301-40231754ac22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:49.837142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc700c-f559-4d98-a301-40231754ac22 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:49.837426 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc700c-f559-4d98-a301-40231754ac22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:49.837708 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc700c-f559-4d98-a301-40231754ac22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:49.908854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc700c-f559-4d98-a301-40231754ac22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:49.910374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc700c-f559-4d98-a301-40231754ac22 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:49.921751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1189/2361] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:52.552128 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20fb61-e04f-44e3-aa34-cb0c4feb5a7b None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:52.617554 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20fb61-e04f-44e3-aa34-cb0c4feb5a7b None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:52.622163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436d765-08d3-475c-b947-23066308623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:52.623125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436d765-08d3-475c-b947-23066308623b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:52.623412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436d765-08d3-475c-b947-23066308623b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:52.623710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436d765-08d3-475c-b947-23066308623b admin admin] PATH_INFO: `/v3/users/797db1020f8f4fa8ae6ff0ea6bcff97a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:52.624908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436d765-08d3-475c-b947-23066308623b admin admin] RBAC: Authorizing `identity:delete_user(user_id=797db1020f8f4fa8ae6ff0ea6bcff97a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:52.626883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436d765-08d3-475c-b947-23066308623b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:52.675150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e436d765-08d3-475c-b947-23066308623b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797db1020f8f4fa8ae6ff0ea6bcff97a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:52.675712 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e436d765-08d3-475c-b947-23066308623b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797db1020f8f4fa8ae6ff0ea6bcff97a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:52.682471 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e436d765-08d3-475c-b947-23066308623b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797db1020f8f4fa8ae6ff0ea6bcff97a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:52.690600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e436d765-08d3-475c-b947-23066308623b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797db1020f8f4fa8ae6ff0ea6bcff97a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:52.702503 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e436d765-08d3-475c-b947-23066308623b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797db1020f8f4fa8ae6ff0ea6bcff97a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:52.708553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1173/2362] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:22:52 2022] DELETE /identity/v3/users/797db1020f8f4fa8ae6ff0ea6bcff97a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:52.713183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447e663-56c5-47bc-ae16-ec2154322c79 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:52.713659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447e663-56c5-47bc-ae16-ec2154322c79 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:52.713772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447e663-56c5-47bc-ae16-ec2154322c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:52.731158 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5447e663-56c5-47bc-ae16-ec2154322c79 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:52.732445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5447e663-56c5-47bc-ae16-ec2154322c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:52.795391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1190/2363] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:52.805380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436d765-08d3-475c-b947-23066308623b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:52.807060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e436d765-08d3-475c-b947-23066308623b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:52.847865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:52.875361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436d765-08d3-475c-b947-23066308623b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:52.879070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd815e85-d0c3-4b90-8bf0-c7c851369ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:52.879741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815e85-d0c3-4b90-8bf0-c7c851369ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:52.880021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815e85-d0c3-4b90-8bf0-c7c851369ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:52.880293 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815e85-d0c3-4b90-8bf0-c7c851369ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:52.890992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd815e85-d0c3-4b90-8bf0-c7c851369ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:52.892451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd815e85-d0c3-4b90-8bf0-c7c851369ac5 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:52.902532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1174/2364] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:53.235976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447e663-56c5-47bc-ae16-ec2154322c79 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:53.237608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5447e663-56c5-47bc-ae16-ec2154322c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:53.248017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:53.252685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447e663-56c5-47bc-ae16-ec2154322c79 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:53.266172 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:53.267489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:53.267845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:53.268174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] PATH_INFO: `/v3/projects/5f2d6bd018e740f79f1de9591deac37d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:53.269646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2d6bd018e740f79f1de9591deac37d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:53.272198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:53.327577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2d6bd018e740f79f1de9591deac37d', 'request_id': 'req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:53.334115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2d6bd018e740f79f1de9591deac37d', 'request_id': 'req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:53.343291 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2d6bd018e740f79f1de9591deac37d', 'request_id': 'req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:53.354056 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] The token cache is being invalidate because project 5f2d6bd018e740f79f1de9591deac37d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:22:53.354363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:53.354979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:53.356602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1191/2365] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:22:53 2022] DELETE /identity/v3/projects/5f2d6bd018e740f79f1de9591deac37d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:53.360937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd815e85-d0c3-4b90-8bf0-c7c851369ac5 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:53.371543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd815e85-d0c3-4b90-8bf0-c7c851369ac5 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:53.428919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386e1b2-5e31-4687-827d-c4caabeb0871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:53.429804 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386e1b2-5e31-4687-827d-c4caabeb0871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:53.430084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386e1b2-5e31-4687-827d-c4caabeb0871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:53.430388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386e1b2-5e31-4687-827d-c4caabeb0871 admin admin] PATH_INFO: `/v3/users/b38b2d8e2bec40b18480c38ff3753373` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:53.431609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386e1b2-5e31-4687-827d-c4caabeb0871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38b2d8e2bec40b18480c38ff3753373)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:53.433547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386e1b2-5e31-4687-827d-c4caabeb0871 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:53.482861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-7386e1b2-5e31-4687-827d-c4caabeb0871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38b2d8e2bec40b18480c38ff3753373'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:53.483427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-7386e1b2-5e31-4687-827d-c4caabeb0871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38b2d8e2bec40b18480c38ff3753373'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:53.490307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-7386e1b2-5e31-4687-827d-c4caabeb0871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38b2d8e2bec40b18480c38ff3753373'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:53.498526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-7386e1b2-5e31-4687-827d-c4caabeb0871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38b2d8e2bec40b18480c38ff3753373'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:53.511159 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-7386e1b2-5e31-4687-827d-c4caabeb0871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38b2d8e2bec40b18480c38ff3753373'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:53.517308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1175/2366] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:22:53 2022] DELETE /identity/v3/users/b38b2d8e2bec40b18480c38ff3753373 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:53.984816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:53.986756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:54.006811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ac8a3-7f4b-4615-9cf1-831d5df6334f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:54.084795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:54.085694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:54.085974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:54.086246 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] PATH_INFO: `/v3/projects/2b70a58529c44665b40162e058ec4f36` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:54.087512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b70a58529c44665b40162e058ec4f36)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:54.089464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:54.149831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b70a58529c44665b40162e058ec4f36', 'request_id': 'req-93c0acad-af85-475f-9473-def14199c819'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:54.161656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b70a58529c44665b40162e058ec4f36', 'request_id': 'req-93c0acad-af85-475f-9473-def14199c819'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:54.178207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b70a58529c44665b40162e058ec4f36', 'request_id': 'req-93c0acad-af85-475f-9473-def14199c819'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:54.190452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] The token cache is being invalidate because project 2b70a58529c44665b40162e058ec4f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:22:54.190821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:54.191520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-93c0acad-af85-475f-9473-def14199c819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:54.197259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1192/2367] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:22:53 2022] DELETE /identity/v3/projects/2b70a58529c44665b40162e058ec4f36 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:22:54.199081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31afb5-7a55-4f01-8f30-9efba7bcaf20 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:54.199574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31afb5-7a55-4f01-8f30-9efba7bcaf20 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:54.199721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31afb5-7a55-4f01-8f30-9efba7bcaf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:54.224648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-da31afb5-7a55-4f01-8f30-9efba7bcaf20 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:54.226231 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-da31afb5-7a55-4f01-8f30-9efba7bcaf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:54.295681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:54.315704 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1176/2368] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:54.323705 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc3db-ae25-468b-994e-beceb34ad490 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:54.324203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc3db-ae25-468b-994e-beceb34ad490 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:54.324485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffc3db-ae25-468b-994e-beceb34ad490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:54.344512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-50ffc3db-ae25-468b-994e-beceb34ad490 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:54.345734 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-50ffc3db-ae25-468b-994e-beceb34ad490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:54.358190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1193/2369] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:54.359565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31afb5-7a55-4f01-8f30-9efba7bcaf20 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:54.371228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31afb5-7a55-4f01-8f30-9efba7bcaf20 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:54.377510 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8fd44-7084-4405-9443-c206d644c50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:54.378531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8fd44-7084-4405-9443-c206d644c50b admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:54.378815 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8fd44-7084-4405-9443-c206d644c50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:54.379095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8fd44-7084-4405-9443-c206d644c50b admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:54.379932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8fd44-7084-4405-9443-c206d644c50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:22:54.380286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8fd44-7084-4405-9443-c206d644c50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:54.382427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8fd44-7084-4405-9443-c206d644c50b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:54.399978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1177/2370] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:22:54.401178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffc3db-ae25-468b-994e-beceb34ad490 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:54.410907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffc3db-ae25-468b-994e-beceb34ad490 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:54.416290 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba4a54-1ba2-410a-b5e4-f293d83737c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:54.416698 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba4a54-1ba2-410a-b5e4-f293d83737c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:54.416977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba4a54-1ba2-410a-b5e4-f293d83737c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:54.417247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba4a54-1ba2-410a-b5e4-f293d83737c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:54.417942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba4a54-1ba2-410a-b5e4-f293d83737c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:54.420122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba4a54-1ba2-410a-b5e4-f293d83737c7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:54.429411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:54.466564 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1194/2371] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:22:54 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:54.469604 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8fd44-7084-4405-9443-c206d644c50b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:54.484242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8fd44-7084-4405-9443-c206d644c50b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:54.559311 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7620-00f5-4086-8808-f5aa541f3ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:54.561186 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7620-00f5-4086-8808-f5aa541f3ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:54.561444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7620-00f5-4086-8808-f5aa541f3ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:54.561718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7620-00f5-4086-8808-f5aa541f3ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:54.562595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7620-00f5-4086-8808-f5aa541f3ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:54.564628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7620-00f5-4086-8808-f5aa541f3ed1 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:54.589853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1178/2372] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:22:54 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:54.595293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba4a54-1ba2-410a-b5e4-f293d83737c7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:54.609236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba4a54-1ba2-410a-b5e4-f293d83737c7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:54.614551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f1acd-803c-4495-b31c-4b308009acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:54.614863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f1acd-803c-4495-b31c-4b308009acf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:54.615143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f1acd-803c-4495-b31c-4b308009acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:54.615411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f1acd-803c-4495-b31c-4b308009acf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:54.616147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f1acd-803c-4495-b31c-4b308009acf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:54.617747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f1acd-803c-4495-b31c-4b308009acf9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:54.631805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1195/2373] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:22:54.632992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7620-00f5-4086-8808-f5aa541f3ed1 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:54.643208 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7620-00f5-4086-8808-f5aa541f3ed1 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:54.647837 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fbc75-07f0-4f1f-9eb1-2d172881540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:54.648560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fbc75-07f0-4f1f-9eb1-2d172881540e admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:54.648842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fbc75-07f0-4f1f-9eb1-2d172881540e admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:54.649113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fbc75-07f0-4f1f-9eb1-2d172881540e admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:54.649851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fbc75-07f0-4f1f-9eb1-2d172881540e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:54.651494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fbc75-07f0-4f1f-9eb1-2d172881540e admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:54.661876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1179/2374] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:54.665900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f1acd-803c-4495-b31c-4b308009acf9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:54.677402 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f1acd-803c-4495-b31c-4b308009acf9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:54.682965 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcafd4c-daf7-42e5-a4a1-4139b1916b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:54.683868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcafd4c-daf7-42e5-a4a1-4139b1916b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:54.684140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcafd4c-daf7-42e5-a4a1-4139b1916b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:54.684624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcafd4c-daf7-42e5-a4a1-4139b1916b5d admin admin] PATH_INFO: `/v3/projects/bbbbd165c3c64682b9f05fc38d26b97a/users/9875ecace604483d8d7a81556663e1f8/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:54.701197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcafd4c-daf7-42e5-a4a1-4139b1916b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbbd165c3c64682b9f05fc38d26b97a, user_id=9875ecace604483d8d7a81556663e1f8, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:54.703931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcafd4c-daf7-42e5-a4a1-4139b1916b5d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:54.719163 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1196/2375] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:22:54 2022] PUT /identity/v3/projects/bbbbd165c3c64682b9f05fc38d26b97a/users/9875ecace604483d8d7a81556663e1f8/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:54.729454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcbae5-3fb7-4a67-925b-82d90605bf4f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:54.729880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcbae5-3fb7-4a67-925b-82d90605bf4f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:54.730232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcbae5-3fb7-4a67-925b-82d90605bf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:54.758720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-97dcbae5-3fb7-4a67-925b-82d90605bf4f None None] MFA Rules not processed for user `9875ecace604483d8d7a81556663e1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:54.759943 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-97dcbae5-3fb7-4a67-925b-82d90605bf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:54.843208 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1180/2376] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:54.844177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcafd4c-daf7-42e5-a4a1-4139b1916b5d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:54.915992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcbae5-3fb7-4a67-925b-82d90605bf4f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:54.918200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-97dcbae5-3fb7-4a67-925b-82d90605bf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:54.988753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcafd4c-daf7-42e5-a4a1-4139b1916b5d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:55.006074 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d850-f7e5-4836-8eed-65167dc53998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:55.006862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d850-f7e5-4836-8eed-65167dc53998 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:55.007085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d850-f7e5-4836-8eed-65167dc53998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:55.007346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d850-f7e5-4836-8eed-65167dc53998 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:55.008055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99d850-f7e5-4836-8eed-65167dc53998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:55.010427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99d850-f7e5-4836-8eed-65167dc53998 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:55.036382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:55.074625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1197/2377] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:22:54 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:22:55.075669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d850-f7e5-4836-8eed-65167dc53998 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:55.095554 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcbae5-3fb7-4a67-925b-82d90605bf4f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:55.221383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d850-f7e5-4836-8eed-65167dc53998 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:55.227384 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0a9b0-1a4c-42de-983d-eac1ad20efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:55.228235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0a9b0-1a4c-42de-983d-eac1ad20efbf admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:55.228613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0a9b0-1a4c-42de-983d-eac1ad20efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:55.229001 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0a9b0-1a4c-42de-983d-eac1ad20efbf admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:55.229926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0a9b0-1a4c-42de-983d-eac1ad20efbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:55.234146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0a9b0-1a4c-42de-983d-eac1ad20efbf admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:55.263731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab1c93-a1df-41f5-8f47-dbe50725aba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:55.264749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1c93-a1df-41f5-8f47-dbe50725aba5 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:55.265171 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1c93-a1df-41f5-8f47-dbe50725aba5 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:55.265524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1c93-a1df-41f5-8f47-dbe50725aba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:55.267875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-25ab1c93-a1df-41f5-8f47-dbe50725aba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:55.272359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1198/2378] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:22:55 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:55.273517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0a9b0-1a4c-42de-983d-eac1ad20efbf admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:55.285000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab1c93-a1df-41f5-8f47-dbe50725aba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:55.286835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab1c93-a1df-41f5-8f47-dbe50725aba5 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:55.295514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0a9b0-1a4c-42de-983d-eac1ad20efbf admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:55.301321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1181/2379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:22:55.303228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e004-68d8-49ef-9434-09187482b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:55.304222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e004-68d8-49ef-9434-09187482b243 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:55.304683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e004-68d8-49ef-9434-09187482b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:55.305872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e004-68d8-49ef-9434-09187482b243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:55.307520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737e004-68d8-49ef-9434-09187482b243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:55.309452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737e004-68d8-49ef-9434-09187482b243 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:55.327501 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1199/2380] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:55.331407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab1c93-a1df-41f5-8f47-dbe50725aba5 service nova] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:55.349259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab1c93-a1df-41f5-8f47-dbe50725aba5 service nova] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:55.355659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c3f5c-e8a5-4e5e-8826-a47759aa90d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:55.356735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3f5c-e8a5-4e5e-8826-a47759aa90d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:55.357645 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3f5c-e8a5-4e5e-8826-a47759aa90d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:55.357645 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3f5c-e8a5-4e5e-8826-a47759aa90d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:55.359465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c3f5c-e8a5-4e5e-8826-a47759aa90d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:55.360634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c3f5c-e8a5-4e5e-8826-a47759aa90d7 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:55.373218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1182/2381] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:55.377393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e004-68d8-49ef-9434-09187482b243 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:55.388102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e004-68d8-49ef-9434-09187482b243 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:55.392885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524b28e-74b3-4348-a27e-eae53aeaaf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:55.393890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524b28e-74b3-4348-a27e-eae53aeaaf98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:55.394240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524b28e-74b3-4348-a27e-eae53aeaaf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:55.394616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524b28e-74b3-4348-a27e-eae53aeaaf98 admin admin] PATH_INFO: `/v3/projects/32e50fc4d0ab41e7bfd04d0d1ea0f583/users/a61001236ab546118ea50b97aa2ff39f/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:55.414612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524b28e-74b3-4348-a27e-eae53aeaaf98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e50fc4d0ab41e7bfd04d0d1ea0f583, user_id=a61001236ab546118ea50b97aa2ff39f, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:55.417464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524b28e-74b3-4348-a27e-eae53aeaaf98 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:55.420220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:55.441642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1200/2382] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:22:55 2022] PUT /identity/v3/projects/32e50fc4d0ab41e7bfd04d0d1ea0f583/users/a61001236ab546118ea50b97aa2ff39f/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:55.446072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf626-18a5-4cb1-8981-07d9b0b23ef2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:55.446461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf626-18a5-4cb1-8981-07d9b0b23ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:55.446882 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf626-18a5-4cb1-8981-07d9b0b23ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:55.478209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f5bdf626-18a5-4cb1-8981-07d9b0b23ef2 None None] MFA Rules not processed for user `a61001236ab546118ea50b97aa2ff39f`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:55.479620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f5bdf626-18a5-4cb1-8981-07d9b0b23ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:55.569864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1183/2383] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:55.573815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524b28e-74b3-4348-a27e-eae53aeaaf98 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:55.684498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524b28e-74b3-4348-a27e-eae53aeaaf98 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:55.692297 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d7f30-e88a-40ea-9971-841f919aed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:55.694314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d7f30-e88a-40ea-9971-841f919aed34 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:55.694795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d7f30-e88a-40ea-9971-841f919aed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:55.695415 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d7f30-e88a-40ea-9971-841f919aed34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:55.696302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d7f30-e88a-40ea-9971-841f919aed34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:55.698732 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d7f30-e88a-40ea-9971-841f919aed34 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:55.750449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1201/2384] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:22:55 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:22:55.751099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdf626-18a5-4cb1-8981-07d9b0b23ef2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:55.768684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdf626-18a5-4cb1-8981-07d9b0b23ef2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:55.836393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:55.853971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14510-f655-420e-91c5-cc78efbed941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:55.854750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14510-f655-420e-91c5-cc78efbed941 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:55.855031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14510-f655-420e-91c5-cc78efbed941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:55.855302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14510-f655-420e-91c5-cc78efbed941 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:55.856056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad14510-f655-420e-91c5-cc78efbed941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:55.858445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad14510-f655-420e-91c5-cc78efbed941 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:55.886573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1184/2385] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:22:55 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:22:55.890513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d7f30-e88a-40ea-9971-841f919aed34 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:55.901652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d7f30-e88a-40ea-9971-841f919aed34 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:55.906667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250717d-4555-4f3a-9089-fff1489dadb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:55.907348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250717d-4555-4f3a-9089-fff1489dadb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:55.907632 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250717d-4555-4f3a-9089-fff1489dadb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:55.907919 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250717d-4555-4f3a-9089-fff1489dadb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:55.908879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250717d-4555-4f3a-9089-fff1489dadb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:55.910548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250717d-4555-4f3a-9089-fff1489dadb7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:55.927243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1202/2386] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:22:55.928637 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14510-f655-420e-91c5-cc78efbed941 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:55.940326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14510-f655-420e-91c5-cc78efbed941 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:55.946376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f8fa7-7a98-4296-a40a-385875101e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:55.947597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8fa7-7a98-4296-a40a-385875101e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:55.947916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8fa7-7a98-4296-a40a-385875101e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:55.948189 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8fa7-7a98-4296-a40a-385875101e92 admin admin] PATH_INFO: `/v3/projects/6c870b8f2d284e1983c5611a555f8f8e/users/fcb0861adbcf4f9e83900b53d13a452c/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:55.971629 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f8fa7-7a98-4296-a40a-385875101e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c870b8f2d284e1983c5611a555f8f8e, user_id=fcb0861adbcf4f9e83900b53d13a452c, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:55.974402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f8fa7-7a98-4296-a40a-385875101e92 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:55.990933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1185/2387] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:22:55 2022] PUT /identity/v3/projects/6c870b8f2d284e1983c5611a555f8f8e/users/fcb0861adbcf4f9e83900b53d13a452c/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:55.994883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250717d-4555-4f3a-9089-fff1489dadb7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:56.005764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250717d-4555-4f3a-9089-fff1489dadb7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:56.089193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba091c26-4086-41b3-981e-2d1013ef2ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:56.089938 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba091c26-4086-41b3-981e-2d1013ef2ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:56.090221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba091c26-4086-41b3-981e-2d1013ef2ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:56.090594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba091c26-4086-41b3-981e-2d1013ef2ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:56.091672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba091c26-4086-41b3-981e-2d1013ef2ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:56.093568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba091c26-4086-41b3-981e-2d1013ef2ecf admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:56.111385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1203/2388] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:22:56.115521 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f8fa7-7a98-4296-a40a-385875101e92 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:56.144267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f8fa7-7a98-4296-a40a-385875101e92 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:56.151561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b1e15-2d80-4f2c-a663-8e617d78a8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:56.152040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b1e15-2d80-4f2c-a663-8e617d78a8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:56.152455 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b1e15-2d80-4f2c-a663-8e617d78a8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:56.152827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b1e15-2d80-4f2c-a663-8e617d78a8fd admin admin] PATH_INFO: `/v3/projects/6c870b8f2d284e1983c5611a555f8f8e/users/fcb0861adbcf4f9e83900b53d13a452c/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:56.155023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b1e15-2d80-4f2c-a663-8e617d78a8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c870b8f2d284e1983c5611a555f8f8e, user_id=fcb0861adbcf4f9e83900b53d13a452c, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:56.157864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b1e15-2d80-4f2c-a663-8e617d78a8fd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:56.178243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1186/2389] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:22:56 2022] PUT /identity/v3/projects/6c870b8f2d284e1983c5611a555f8f8e/users/fcb0861adbcf4f9e83900b53d13a452c/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:56.189328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a1d1c-f519-44a9-abb7-db129931631a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:56.189735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a1d1c-f519-44a9-abb7-db129931631a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:56.195213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a1d1c-f519-44a9-abb7-db129931631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:56.244283 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-854a1d1c-f519-44a9-abb7-db129931631a None None] MFA Rules not processed for user `fcb0861adbcf4f9e83900b53d13a452c`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:22:56.245951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-854a1d1c-f519-44a9-abb7-db129931631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:56.317417 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:56.347588 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1204/2390] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:22:56.372288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b1e15-2d80-4f2c-a663-8e617d78a8fd admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:56.375946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-df1b1e15-2d80-4f2c-a663-8e617d78a8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:56.448036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b1e15-2d80-4f2c-a663-8e617d78a8fd admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:56.452481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb36e-f8d8-4133-a882-0dc3c117dd9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:56.453272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb36e-f8d8-4133-a882-0dc3c117dd9b service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:56.453621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb36e-f8d8-4133-a882-0dc3c117dd9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:56.453958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb36e-f8d8-4133-a882-0dc3c117dd9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:56.524570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbb36e-f8d8-4133-a882-0dc3c117dd9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:56.526049 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbb36e-f8d8-4133-a882-0dc3c117dd9b service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:56.536336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1187/2391] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:56.623403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a1d1c-f519-44a9-abb7-db129931631a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:56.624939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-854a1d1c-f519-44a9-abb7-db129931631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:56.728507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a1d1c-f519-44a9-abb7-db129931631a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:56.733600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:56.734610 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:56.734947 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:56.735904 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] PATH_INFO: `/v3/users/15f7b282d2a04428bfd97db2f4264a46` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:56.738222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f7b282d2a04428bfd97db2f4264a46)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:56.740229 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:56.806087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f7b282d2a04428bfd97db2f4264a46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:56.807505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f7b282d2a04428bfd97db2f4264a46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:56.822887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f7b282d2a04428bfd97db2f4264a46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:56.840389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f7b282d2a04428bfd97db2f4264a46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:56.863395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f7b282d2a04428bfd97db2f4264a46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:56.871970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1205/2392] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:22:56 2022] DELETE /identity/v3/users/15f7b282d2a04428bfd97db2f4264a46 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:57.206733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb36e-f8d8-4133-a882-0dc3c117dd9b service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:57.226677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb36e-f8d8-4133-a882-0dc3c117dd9b service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:57.292451 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:57.299529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:57.300651 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:57.301012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:57.301296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] PATH_INFO: `/v3/projects/8a573692ff904f3abfb94346fddaab74` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:57.302614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a573692ff904f3abfb94346fddaab74)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:57.305328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:57.354265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a573692ff904f3abfb94346fddaab74', 'request_id': 'req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.363028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a573692ff904f3abfb94346fddaab74', 'request_id': 'req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.371126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a573692ff904f3abfb94346fddaab74', 'request_id': 'req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.382151 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] The token cache is being invalidate because project 8a573692ff904f3abfb94346fddaab74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:22:57.382749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.383077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.384683 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1188/2393] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:22:57 2022] DELETE /identity/v3/projects/8a573692ff904f3abfb94346fddaab74 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:57.391369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:57.393418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:57.408743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedc0f8-42be-4f5d-a6eb-91d677cc3779 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:57.474357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:57.475296 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:57.475581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:57.475855 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] PATH_INFO: `/v3/users/e68d24ad7c744bc3b89be0d68174e034` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:57.477157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68d24ad7c744bc3b89be0d68174e034)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:57.479173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:57.493852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:57.537665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68d24ad7c744bc3b89be0d68174e034'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.538352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68d24ad7c744bc3b89be0d68174e034'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.548053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68d24ad7c744bc3b89be0d68174e034'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.560068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68d24ad7c744bc3b89be0d68174e034'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.567885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68d24ad7c744bc3b89be0d68174e034'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.574773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1206/2394] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:22:57 2022] DELETE /identity/v3/users/e68d24ad7c744bc3b89be0d68174e034 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:57.761416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:57.763176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:57.777137 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ad1e4-83ae-4046-bebb-d3265ca3e9b1 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:57.840413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:57.841334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:57.841608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:57.841877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] PATH_INFO: `/v3/projects/94e663ebb1e4478ca3bd8b554c390a49` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:57.843501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e663ebb1e4478ca3bd8b554c390a49)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:57.845415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:57.895508 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e663ebb1e4478ca3bd8b554c390a49', 'request_id': 'req-741ba0be-73bd-465e-8af3-36dd63df9eb6'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.901698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e663ebb1e4478ca3bd8b554c390a49', 'request_id': 'req-741ba0be-73bd-465e-8af3-36dd63df9eb6'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.911175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e663ebb1e4478ca3bd8b554c390a49', 'request_id': 'req-741ba0be-73bd-465e-8af3-36dd63df9eb6'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.921590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] The token cache is being invalidate because project 94e663ebb1e4478ca3bd8b554c390a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:22:57.921869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.922543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:22:57.924072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1189/2395] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:22:57 2022] DELETE /identity/v3/projects/94e663ebb1e4478ca3bd8b554c390a49 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:22:58.148394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:58.149975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:58.210842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b06025-4220-4473-845f-701407a0c751 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:58.262443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d10fb9-4bdf-4574-9441-c9c3ff7557fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:58.263628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d10fb9-4bdf-4574-9441-c9c3ff7557fd service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:58.263927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d10fb9-4bdf-4574-9441-c9c3ff7557fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:58.264195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d10fb9-4bdf-4574-9441-c9c3ff7557fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:58.266573 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f7d10fb9-4bdf-4574-9441-c9c3ff7557fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:58.324420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d10fb9-4bdf-4574-9441-c9c3ff7557fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:58.326513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d10fb9-4bdf-4574-9441-c9c3ff7557fd service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:58.329984 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:58.336820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1207/2396] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:22:58.916274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:22:58.917774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:58.931426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ba0be-73bd-465e-8af3-36dd63df9eb6 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:22:58.935630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a3859-948e-4c51-90a4-de6e91d030e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:22:58.936271 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a3859-948e-4c51-90a4-de6e91d030e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:22:58.936550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a3859-948e-4c51-90a4-de6e91d030e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:22:58.936818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a3859-948e-4c51-90a4-de6e91d030e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:22:58.938721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e48a3859-948e-4c51-90a4-de6e91d030e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:22:58.953304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:59.006230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a3859-948e-4c51-90a4-de6e91d030e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:22:59.007616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a3859-948e-4c51-90a4-de6e91d030e5 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:22:59.018626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1190/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:22:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:00.915349 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d10fb9-4bdf-4574-9441-c9c3ff7557fd service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:00.916913 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f7d10fb9-4bdf-4574-9441-c9c3ff7557fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:00.977581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d10fb9-4bdf-4574-9441-c9c3ff7557fd service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:00.981788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2f377-8234-4351-8c63-047401371c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:00.982483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f377-8234-4351-8c63-047401371c3b service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:00.982764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f377-8234-4351-8c63-047401371c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:00.983041 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f377-8234-4351-8c63-047401371c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:00.985029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-51f2f377-8234-4351-8c63-047401371c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:01.050357 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2f377-8234-4351-8c63-047401371c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:01.052612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2f377-8234-4351-8c63-047401371c3b service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:01.064853 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1208/2398] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:01.763887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a3859-948e-4c51-90a4-de6e91d030e5 service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:01.766892 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e48a3859-948e-4c51-90a4-de6e91d030e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:01.853974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a3859-948e-4c51-90a4-de6e91d030e5 service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:01.859771 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247f011-9f7f-49e9-aaa4-85ccdfd463be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:01.860437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247f011-9f7f-49e9-aaa4-85ccdfd463be service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:01.860720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247f011-9f7f-49e9-aaa4-85ccdfd463be service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:01.860997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247f011-9f7f-49e9-aaa4-85ccdfd463be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:01.862803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b247f011-9f7f-49e9-aaa4-85ccdfd463be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:01.931430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247f011-9f7f-49e9-aaa4-85ccdfd463be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:01.933055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247f011-9f7f-49e9-aaa4-85ccdfd463be service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:01.943149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1191/2399] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:02.887605 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2f377-8234-4351-8c63-047401371c3b service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:02.889513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-51f2f377-8234-4351-8c63-047401371c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:02.904214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2f377-8234-4351-8c63-047401371c3b service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:02.909637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:02.910659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:02.911143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:02.911485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] PATH_INFO: `/v3/users/9875ecace604483d8d7a81556663e1f8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:02.912815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9875ecace604483d8d7a81556663e1f8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:02.914870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:02.972341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9875ecace604483d8d7a81556663e1f8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:02.973059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9875ecace604483d8d7a81556663e1f8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:02.982589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9875ecace604483d8d7a81556663e1f8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:02.997787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9875ecace604483d8d7a81556663e1f8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:03.004887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9875ecace604483d8d7a81556663e1f8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:03.011231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1209/2400] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:02 2022] DELETE /identity/v3/users/9875ecace604483d8d7a81556663e1f8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:03.016031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38096a-f0bd-4996-b053-7f4968e3e51a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:03.016531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38096a-f0bd-4996-b053-7f4968e3e51a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:03.016627 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38096a-f0bd-4996-b053-7f4968e3e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:03.045022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-ab38096a-f0bd-4996-b053-7f4968e3e51a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:03.047136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ab38096a-f0bd-4996-b053-7f4968e3e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:03.111100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:03.143059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1192/2401] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:03.152557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:03.154274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:03.188314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:03.230648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad1bf2-b60f-4900-9454-4f7cb6209c20 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:03.234495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf383ad-41b8-42f9-9de8-dc8e46e9e6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:03.235179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf383ad-41b8-42f9-9de8-dc8e46e9e6cf service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:03.235957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf383ad-41b8-42f9-9de8-dc8e46e9e6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:03.236238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf383ad-41b8-42f9-9de8-dc8e46e9e6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:03.248577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf383ad-41b8-42f9-9de8-dc8e46e9e6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:03.249951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf383ad-41b8-42f9-9de8-dc8e46e9e6cf service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:03.260241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1210/2402] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:03.611015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38096a-f0bd-4996-b053-7f4968e3e51a None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:03.612819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ab38096a-f0bd-4996-b053-7f4968e3e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:03.627676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38096a-f0bd-4996-b053-7f4968e3e51a None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:03.633600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:03.635240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:03.635734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:03.636192 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] PATH_INFO: `/v3/projects/bbbbd165c3c64682b9f05fc38d26b97a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:03.638222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbbd165c3c64682b9f05fc38d26b97a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:03.640792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:03.724008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbbd165c3c64682b9f05fc38d26b97a', 'request_id': 'req-d36d1f7e-b19b-485b-9b63-c499152d197f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:03.735093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbbd165c3c64682b9f05fc38d26b97a', 'request_id': 'req-d36d1f7e-b19b-485b-9b63-c499152d197f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:03.756774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbbd165c3c64682b9f05fc38d26b97a', 'request_id': 'req-d36d1f7e-b19b-485b-9b63-c499152d197f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:03.775260 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] The token cache is being invalidate because project bbbbd165c3c64682b9f05fc38d26b97a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:03.775681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:03.776441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:03.778606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1193/2403] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:03 2022] DELETE /identity/v3/projects/bbbbd165c3c64682b9f05fc38d26b97a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:03.783761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf383ad-41b8-42f9-9de8-dc8e46e9e6cf service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:03.797951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf383ad-41b8-42f9-9de8-dc8e46e9e6cf service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:03.891398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:03.892305 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:03.892577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:03.892845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] PATH_INFO: `/v3/users/a61001236ab546118ea50b97aa2ff39f` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:03.894129 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61001236ab546118ea50b97aa2ff39f)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:03.896089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:03.967571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61001236ab546118ea50b97aa2ff39f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:03.968250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61001236ab546118ea50b97aa2ff39f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:03.979921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61001236ab546118ea50b97aa2ff39f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:03.994153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61001236ab546118ea50b97aa2ff39f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.005207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61001236ab546118ea50b97aa2ff39f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.012271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1211/2404] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:03 2022] DELETE /identity/v3/users/a61001236ab546118ea50b97aa2ff39f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:04.382240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:04.384334 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:04.399296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d1f7e-b19b-485b-9b63-c499152d197f admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:04.483377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:04.485554 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:04.485947 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:04.486419 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] PATH_INFO: `/v3/projects/32e50fc4d0ab41e7bfd04d0d1ea0f583` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:04.487755 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e50fc4d0ab41e7bfd04d0d1ea0f583)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:04.489705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:04.559359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e50fc4d0ab41e7bfd04d0d1ea0f583', 'request_id': 'req-df10c137-bc5f-4358-b3aa-177c864fd9b5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.569332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e50fc4d0ab41e7bfd04d0d1ea0f583', 'request_id': 'req-df10c137-bc5f-4358-b3aa-177c864fd9b5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.578696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e50fc4d0ab41e7bfd04d0d1ea0f583', 'request_id': 'req-df10c137-bc5f-4358-b3aa-177c864fd9b5'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.590182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] The token cache is being invalidate because project 32e50fc4d0ab41e7bfd04d0d1ea0f583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:04.590522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.591809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.593932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1194/2405] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:04 2022] DELETE /identity/v3/projects/32e50fc4d0ab41e7bfd04d0d1ea0f583 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:04.598131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:04.599745 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:04.619210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dbc22-80d1-4213-8f96-b0db2538d9a8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:04.637693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:04.647660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:04.658393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:04.675895 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:04.694783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:04.695711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:04.695998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:04.696267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] PATH_INFO: `/v3/users/fcb0861adbcf4f9e83900b53d13a452c` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:04.697460 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb0861adbcf4f9e83900b53d13a452c)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:04.699483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:04.743086 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c137-bc5f-4358-b3aa-177c864fd9b5 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:04.748654 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:04.749540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:04.749821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:04.750091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] PATH_INFO: `/v3/users/d8733e916d634c0a967ba35261e0c3ec` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:04.751413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8733e916d634c0a967ba35261e0c3ec)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:04.753401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:04.754550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb0861adbcf4f9e83900b53d13a452c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.755273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb0861adbcf4f9e83900b53d13a452c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.764730 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb0861adbcf4f9e83900b53d13a452c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.777399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb0861adbcf4f9e83900b53d13a452c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.789204 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb0861adbcf4f9e83900b53d13a452c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.797910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1212/2406] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:04 2022] DELETE /identity/v3/users/fcb0861adbcf4f9e83900b53d13a452c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:04.814729 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8733e916d634c0a967ba35261e0c3ec'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.815549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8733e916d634c0a967ba35261e0c3ec'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.823951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8733e916d634c0a967ba35261e0c3ec'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.837858 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8733e916d634c0a967ba35261e0c3ec'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.858982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8733e916d634c0a967ba35261e0c3ec'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:04.876264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1195/2407] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:04 2022] DELETE /identity/v3/users/d8733e916d634c0a967ba35261e0c3ec => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:05.150692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.152707 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:05.209954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.211557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:05.256103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d265-916b-46d7-8c3e-07a6f72b6e80 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.315242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020948fe-e037-49c6-8e47-9719d371b2ba admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.319915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.320806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.321088 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.321396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] PATH_INFO: `/v3/projects/6c870b8f2d284e1983c5611a555f8f8e` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.321851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.322759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c870b8f2d284e1983c5611a555f8f8e)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.322880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.323046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.323316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] PATH_INFO: `/v3/projects/53f458cbd05549a6907c6c10c03f188f` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.324498 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f458cbd05549a6907c6c10c03f188f)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.324954 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.326609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.337174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:05.352483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:05.378102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c870b8f2d284e1983c5611a555f8f8e', 'request_id': 'req-59186c93-ce58-456b-b963-2c373a91128f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:05.378370 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f458cbd05549a6907c6c10c03f188f', 'request_id': 'req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:05.384688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c870b8f2d284e1983c5611a555f8f8e', 'request_id': 'req-59186c93-ce58-456b-b963-2c373a91128f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:05.385265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f458cbd05549a6907c6c10c03f188f', 'request_id': 'req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:05.393861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c870b8f2d284e1983c5611a555f8f8e', 'request_id': 'req-59186c93-ce58-456b-b963-2c373a91128f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:05.396707 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f458cbd05549a6907c6c10c03f188f', 'request_id': 'req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:05.405299 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] The token cache is being invalidate because project 6c870b8f2d284e1983c5611a555f8f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:05.405807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:05.406626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-59186c93-ce58-456b-b963-2c373a91128f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:05.408183 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] The token cache is being invalidate because project 53f458cbd05549a6907c6c10c03f188f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:05.408319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1196/2408] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:05 2022] DELETE /identity/v3/projects/6c870b8f2d284e1983c5611a555f8f8e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:05.412690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:05.413373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5864e73e-d2c7-4fed-a82f-2480bcf9bbfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:05.413937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335f6fb-1a94-409f-a8c7-89658f3586cf None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.414219 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335f6fb-1a94-409f-a8c7-89658f3586cf None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.414521 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335f6fb-1a94-409f-a8c7-89658f3586cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.414993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1213/2409] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:05 2022] DELETE /identity/v3/projects/53f458cbd05549a6907c6c10c03f188f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:05.419835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a674ec-cdd8-403a-b9d4-60dc7fc29b99 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.420145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a674ec-cdd8-403a-b9d4-60dc7fc29b99 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.420410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a674ec-cdd8-403a-b9d4-60dc7fc29b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.437149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5335f6fb-1a94-409f-a8c7-89658f3586cf None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:05.438709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-53a674ec-cdd8-403a-b9d4-60dc7fc29b99 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:05.439075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5335f6fb-1a94-409f-a8c7-89658f3586cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:05.439873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-53a674ec-cdd8-403a-b9d4-60dc7fc29b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:05.499069 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1214/2410] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:05.500786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1197/2411] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:05.508260 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344b216-b608-4405-9e31-c0617b945eb2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.508465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344b216-b608-4405-9e31-c0617b945eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.508559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f265d-9b33-4f9f-b53a-7388acbfe1f7 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.508654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344b216-b608-4405-9e31-c0617b945eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.508817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f265d-9b33-4f9f-b53a-7388acbfe1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.509089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f265d-9b33-4f9f-b53a-7388acbfe1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.527051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-db8f265d-9b33-4f9f-b53a-7388acbfe1f7 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:05.528408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-db8f265d-9b33-4f9f-b53a-7388acbfe1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:05.528851 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c344b216-b608-4405-9e31-c0617b945eb2 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:05.530005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c344b216-b608-4405-9e31-c0617b945eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:05.536498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1198/2412] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:05.538034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1215/2413] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:05.540831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f265d-9b33-4f9f-b53a-7388acbfe1f7 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.541860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344b216-b608-4405-9e31-c0617b945eb2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.551571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344b216-b608-4405-9e31-c0617b945eb2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.552438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f265d-9b33-4f9f-b53a-7388acbfe1f7 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.557554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524163-edee-47f9-97dd-bae28334dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.557725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15263-63da-4e32-924d-367ad2bced35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.558400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15263-63da-4e32-924d-367ad2bced35 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.558616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15263-63da-4e32-924d-367ad2bced35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.558738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524163-edee-47f9-97dd-bae28334dfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.558962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524163-edee-47f9-97dd-bae28334dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.559070 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15263-63da-4e32-924d-367ad2bced35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.559217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524163-edee-47f9-97dd-bae28334dfa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.560257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c15263-63da-4e32-924d-367ad2bced35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:23:05.560411 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524163-edee-47f9-97dd-bae28334dfa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:23:05.560519 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c15263-63da-4e32-924d-367ad2bced35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.560670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524163-edee-47f9-97dd-bae28334dfa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.562081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c15263-63da-4e32-924d-367ad2bced35 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.562988 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524163-edee-47f9-97dd-bae28334dfa2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.575524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1216/2414] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:23:05.575722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1199/2415] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:23:05.579711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524163-edee-47f9-97dd-bae28334dfa2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.580017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15263-63da-4e32-924d-367ad2bced35 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.589456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524163-edee-47f9-97dd-bae28334dfa2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.590518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15263-63da-4e32-924d-367ad2bced35 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.594762 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654b685-ea61-434f-aaf9-c6d718e15a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.595394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b685-ea61-434f-aaf9-c6d718e15a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.595586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6057ac9-065c-4974-b8f5-c04c7598c77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.595718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b685-ea61-434f-aaf9-c6d718e15a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.595927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b685-ea61-434f-aaf9-c6d718e15a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.596230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6057ac9-065c-4974-b8f5-c04c7598c77e admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.596517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6057ac9-065c-4974-b8f5-c04c7598c77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.596619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654b685-ea61-434f-aaf9-c6d718e15a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.596792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6057ac9-065c-4974-b8f5-c04c7598c77e admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.597475 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6057ac9-065c-4974-b8f5-c04c7598c77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.598528 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654b685-ea61-434f-aaf9-c6d718e15a88 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.599429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6057ac9-065c-4974-b8f5-c04c7598c77e admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.627843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1217/2416] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:05 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:05.629313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1200/2417] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:05 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:05.631856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654b685-ea61-434f-aaf9-c6d718e15a88 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.633122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6057ac9-065c-4974-b8f5-c04c7598c77e admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.689218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:05.693615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654b685-ea61-434f-aaf9-c6d718e15a88 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.694489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6057ac9-065c-4974-b8f5-c04c7598c77e admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.699458 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efc78e-2348-4dc7-94c5-8ad9e9092fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.699692 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0c4db-6e73-4ffa-b2a6-d9e21e48f40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.700485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc78e-2348-4dc7-94c5-8ad9e9092fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.700610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c4db-6e73-4ffa-b2a6-d9e21e48f40b admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.701032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c4db-6e73-4ffa-b2a6-d9e21e48f40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.701170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc78e-2348-4dc7-94c5-8ad9e9092fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.701296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0c4db-6e73-4ffa-b2a6-d9e21e48f40b admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.701440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc78e-2348-4dc7-94c5-8ad9e9092fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.702084 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efc78e-2348-4dc7-94c5-8ad9e9092fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.702236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0c4db-6e73-4ffa-b2a6-d9e21e48f40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.704272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0c4db-6e73-4ffa-b2a6-d9e21e48f40b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.704526 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efc78e-2348-4dc7-94c5-8ad9e9092fc3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.721355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:05.727534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1218/2418] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:05 2022] POST /identity/v3/users => generated 278 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:05.731467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1201/2419] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:05 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:05.731860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efc78e-2348-4dc7-94c5-8ad9e9092fc3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.734945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0c4db-6e73-4ffa-b2a6-d9e21e48f40b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.741866 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efc78e-2348-4dc7-94c5-8ad9e9092fc3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.744743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0c4db-6e73-4ffa-b2a6-d9e21e48f40b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.749458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c338d-99f5-4127-acc4-6d1584c52816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.750143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c338d-99f5-4127-acc4-6d1584c52816 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.750457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c338d-99f5-4127-acc4-6d1584c52816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.750731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c338d-99f5-4127-acc4-6d1584c52816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.751469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c338d-99f5-4127-acc4-6d1584c52816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.752453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4840-53bb-4bda-8dec-8b2e9ff6378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.753085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c338d-99f5-4127-acc4-6d1584c52816 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.753221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4840-53bb-4bda-8dec-8b2e9ff6378e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.753385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4840-53bb-4bda-8dec-8b2e9ff6378e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.753647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4840-53bb-4bda-8dec-8b2e9ff6378e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.754410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b4840-53bb-4bda-8dec-8b2e9ff6378e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.756001 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b4840-53bb-4bda-8dec-8b2e9ff6378e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.764016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1202/2420] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:05.767361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1219/2421] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:23:05.768039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c338d-99f5-4127-acc4-6d1584c52816 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.770666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4840-53bb-4bda-8dec-8b2e9ff6378e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.779068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c338d-99f5-4127-acc4-6d1584c52816 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.780351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4840-53bb-4bda-8dec-8b2e9ff6378e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.784796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d50fac-2721-4f7e-ae4b-9964d12a24a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.785257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84f4ec-5b35-4a77-9f58-884fc9e8a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.785552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d50fac-2721-4f7e-ae4b-9964d12a24a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.785840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d50fac-2721-4f7e-ae4b-9964d12a24a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.786006 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84f4ec-5b35-4a77-9f58-884fc9e8a480 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.786165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d50fac-2721-4f7e-ae4b-9964d12a24a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.786349 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84f4ec-5b35-4a77-9f58-884fc9e8a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.786494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84f4ec-5b35-4a77-9f58-884fc9e8a480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.786864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d50fac-2721-4f7e-ae4b-9964d12a24a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.787187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84f4ec-5b35-4a77-9f58-884fc9e8a480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.788500 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d50fac-2721-4f7e-ae4b-9964d12a24a7 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.788906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84f4ec-5b35-4a77-9f58-884fc9e8a480 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.800212 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1220/2422] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:23:05.800595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1203/2423] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:23:05.804352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84f4ec-5b35-4a77-9f58-884fc9e8a480 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.804487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d50fac-2721-4f7e-ae4b-9964d12a24a7 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.814738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84f4ec-5b35-4a77-9f58-884fc9e8a480 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.815355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d50fac-2721-4f7e-ae4b-9964d12a24a7 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:05.819179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64fc4-2f64-403c-b89e-d4269d6f6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.819893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97da5-e86b-41c1-bd32-fd326eddd177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:05.820058 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64fc4-2f64-403c-b89e-d4269d6f6ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.820340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64fc4-2f64-403c-b89e-d4269d6f6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.820609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64fc4-2f64-403c-b89e-d4269d6f6ed6 admin admin] PATH_INFO: `/v3/projects/e1162f117f8b4240a4f3d967435b56dc/users/7c9cc4c806e241638d711ff179beb965/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.820763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97da5-e86b-41c1-bd32-fd326eddd177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.821034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97da5-e86b-41c1-bd32-fd326eddd177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.821430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97da5-e86b-41c1-bd32-fd326eddd177 admin admin] PATH_INFO: `/v3/projects/5a17a0e81c104e17a27a21e66952f1bd/users/8f3f0264d71f49ff98d477bdfacf530d/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.837691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97da5-e86b-41c1-bd32-fd326eddd177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a17a0e81c104e17a27a21e66952f1bd, user_id=8f3f0264d71f49ff98d477bdfacf530d, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.838062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b64fc4-2f64-403c-b89e-d4269d6f6ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1162f117f8b4240a4f3d967435b56dc, user_id=7c9cc4c806e241638d711ff179beb965, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:05.840399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97da5-e86b-41c1-bd32-fd326eddd177 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.840873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b64fc4-2f64-403c-b89e-d4269d6f6ed6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:05.858136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1221/2424] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:05 2022] PUT /identity/v3/projects/e1162f117f8b4240a4f3d967435b56dc/users/7c9cc4c806e241638d711ff179beb965/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:05.858529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1204/2425] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:05 2022] PUT /identity/v3/projects/5a17a0e81c104e17a27a21e66952f1bd/users/8f3f0264d71f49ff98d477bdfacf530d/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:05.868272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852025-b5ab-4f23-91f7-207b510ac10e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.868888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852025-b5ab-4f23-91f7-207b510ac10e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.869355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852025-b5ab-4f23-91f7-207b510ac10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.870471 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb6b3c-ab46-4e98-9a34-639929b290c4 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:05.870779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb6b3c-ab46-4e98-9a34-639929b290c4 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:05.871057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb6b3c-ab46-4e98-9a34-639929b290c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:05.889537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c8852025-b5ab-4f23-91f7-207b510ac10e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:05.890949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c8852025-b5ab-4f23-91f7-207b510ac10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:05.904435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8aeb6b3c-ab46-4e98-9a34-639929b290c4 None None] MFA Rules not processed for user `7c9cc4c806e241638d711ff179beb965`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:05.905981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8aeb6b3c-ab46-4e98-9a34-639929b290c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:05.963386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1222/2426] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:05.973997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8852025-b5ab-4f23-91f7-207b510ac10e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:05.975761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c8852025-b5ab-4f23-91f7-207b510ac10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:05.996424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1205/2427] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:05.997442 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb6b3c-ab46-4e98-9a34-639929b290c4 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:06.010188 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb6b3c-ab46-4e98-9a34-639929b290c4 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:06.015803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b79f-8e67-4986-a348-d03d630eaa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:06.016475 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b79f-8e67-4986-a348-d03d630eaa8d admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.016760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b79f-8e67-4986-a348-d03d630eaa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.017034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b79f-8e67-4986-a348-d03d630eaa8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.017743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627b79f-8e67-4986-a348-d03d630eaa8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:06.020109 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627b79f-8e67-4986-a348-d03d630eaa8d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:06.041724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8852025-b5ab-4f23-91f7-207b510ac10e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:06.050325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1206/2428] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:05 2022] POST /identity/v3/projects => generated 355 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:06.054016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b79f-8e67-4986-a348-d03d630eaa8d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:06.056110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74452b-fb83-4975-8b40-6ab2a3ae025f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:06.060400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74452b-fb83-4975-8b40-6ab2a3ae025f service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.060400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74452b-fb83-4975-8b40-6ab2a3ae025f service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.060400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74452b-fb83-4975-8b40-6ab2a3ae025f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.069196 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74452b-fb83-4975-8b40-6ab2a3ae025f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:06.070939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74452b-fb83-4975-8b40-6ab2a3ae025f service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:06.082584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1223/2429] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:23:06.137937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b79f-8e67-4986-a348-d03d630eaa8d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:06.142839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aa255-20c8-42ba-8dd9-d8b52521da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:06.143681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aa255-20c8-42ba-8dd9-d8b52521da15 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.143964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aa255-20c8-42ba-8dd9-d8b52521da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.144517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aa255-20c8-42ba-8dd9-d8b52521da15 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.144933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aa255-20c8-42ba-8dd9-d8b52521da15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:06.147017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aa255-20c8-42ba-8dd9-d8b52521da15 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:06.172257 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1207/2430] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:06 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:06.175975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74452b-fb83-4975-8b40-6ab2a3ae025f service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:06.188346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74452b-fb83-4975-8b40-6ab2a3ae025f service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:06.194516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01bf6d-93ca-4580-903f-fee139abfbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:06.195287 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01bf6d-93ca-4580-903f-fee139abfbec admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.195634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01bf6d-93ca-4580-903f-fee139abfbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.196092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01bf6d-93ca-4580-903f-fee139abfbec admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.196896 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01bf6d-93ca-4580-903f-fee139abfbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:06.198646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01bf6d-93ca-4580-903f-fee139abfbec admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:06.213856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1224/2431] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:06.219553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aa255-20c8-42ba-8dd9-d8b52521da15 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:06.231993 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aa255-20c8-42ba-8dd9-d8b52521da15 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:06.238756 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf462d84-4921-497f-9a0e-33168d5e6a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:06.239832 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf462d84-4921-497f-9a0e-33168d5e6a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.240146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf462d84-4921-497f-9a0e-33168d5e6a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.240457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf462d84-4921-497f-9a0e-33168d5e6a21 admin admin] PATH_INFO: `/v3/projects/29385a9eb1674aba93508b1fe8920ead/users/38ea6ef46d8f4932b53ca5416ae4f5ed/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.252155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:06.263503 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf462d84-4921-497f-9a0e-33168d5e6a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29385a9eb1674aba93508b1fe8920ead, user_id=38ea6ef46d8f4932b53ca5416ae4f5ed, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:06.269154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf462d84-4921-497f-9a0e-33168d5e6a21 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:06.286414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1208/2432] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:06 2022] PUT /identity/v3/projects/29385a9eb1674aba93508b1fe8920ead/users/38ea6ef46d8f4932b53ca5416ae4f5ed/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:06.290723 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01bf6d-93ca-4580-903f-fee139abfbec admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:06.305946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01bf6d-93ca-4580-903f-fee139abfbec admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:06.348645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:06.388184 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce7589-f875-4be1-935c-92e034ddca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:06.388906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce7589-f875-4be1-935c-92e034ddca17 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.389190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce7589-f875-4be1-935c-92e034ddca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.395116 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce7589-f875-4be1-935c-92e034ddca17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.395938 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce7589-f875-4be1-935c-92e034ddca17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:06.397730 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce7589-f875-4be1-935c-92e034ddca17 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:06.410766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1225/2433] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:06.415375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf462d84-4921-497f-9a0e-33168d5e6a21 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:06.433631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf462d84-4921-497f-9a0e-33168d5e6a21 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:06.441854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7374-ed22-4d7f-8802-feede0814f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:06.443923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7374-ed22-4d7f-8802-feede0814f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.444278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7374-ed22-4d7f-8802-feede0814f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.444561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7374-ed22-4d7f-8802-feede0814f05 admin admin] PATH_INFO: `/v3/projects/29385a9eb1674aba93508b1fe8920ead/users/38ea6ef46d8f4932b53ca5416ae4f5ed/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.447456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea7374-ed22-4d7f-8802-feede0814f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29385a9eb1674aba93508b1fe8920ead, user_id=38ea6ef46d8f4932b53ca5416ae4f5ed, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:06.457646 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea7374-ed22-4d7f-8802-feede0814f05 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:06.473584 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1209/2434] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:06 2022] PUT /identity/v3/projects/29385a9eb1674aba93508b1fe8920ead/users/38ea6ef46d8f4932b53ca5416ae4f5ed/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:06.485973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58df161-866c-45fd-89c6-b726ea756d69 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.486269 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58df161-866c-45fd-89c6-b726ea756d69 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.486568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58df161-866c-45fd-89c6-b726ea756d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.517399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d58df161-866c-45fd-89c6-b726ea756d69 None None] MFA Rules not processed for user `38ea6ef46d8f4932b53ca5416ae4f5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:06.518637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d58df161-866c-45fd-89c6-b726ea756d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:06.591495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1226/2435] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:06 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:06.603542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7374-ed22-4d7f-8802-feede0814f05 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:06.605373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-2aea7374-ed22-4d7f-8802-feede0814f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:06.664613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7374-ed22-4d7f-8802-feede0814f05 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:06.668227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c24461-837d-47df-8ae8-aec9f3cece8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:06.669806 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24461-837d-47df-8ae8-aec9f3cece8b service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.670094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24461-837d-47df-8ae8-aec9f3cece8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.670395 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24461-837d-47df-8ae8-aec9f3cece8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.680121 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c24461-837d-47df-8ae8-aec9f3cece8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:06.681565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c24461-837d-47df-8ae8-aec9f3cece8b service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:06.692191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1210/2436] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:06 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:06.772928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58df161-866c-45fd-89c6-b726ea756d69 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:06.784425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58df161-866c-45fd-89c6-b726ea756d69 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:06.791059 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c16a64-2866-4bb0-8542-07dd860144df None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.791350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c16a64-2866-4bb0-8542-07dd860144df None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.791462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775af485-bb5a-4edd-970a-b4f70794c624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:06.791615 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c16a64-2866-4bb0-8542-07dd860144df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.792221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af485-bb5a-4edd-970a-b4f70794c624 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.792967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af485-bb5a-4edd-970a-b4f70794c624 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.793251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af485-bb5a-4edd-970a-b4f70794c624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.827686 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-21c16a64-2866-4bb0-8542-07dd860144df None None] MFA Rules not processed for user `8f3f0264d71f49ff98d477bdfacf530d`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:06.829952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-21c16a64-2866-4bb0-8542-07dd860144df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:06.869591 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775af485-bb5a-4edd-970a-b4f70794c624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:06.871118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775af485-bb5a-4edd-970a-b4f70794c624 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:06.881997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1227/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:06 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:06.917847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1211/2438] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:06.929293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775af485-bb5a-4edd-970a-b4f70794c624 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:06.930944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-775af485-bb5a-4edd-970a-b4f70794c624 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:06.943831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775af485-bb5a-4edd-970a-b4f70794c624 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:06.949182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad669afc-e45f-4ced-bc1a-3682ddfa56a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:06.950176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669afc-e45f-4ced-bc1a-3682ddfa56a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:06.951215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669afc-e45f-4ced-bc1a-3682ddfa56a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:06.951557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669afc-e45f-4ced-bc1a-3682ddfa56a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:06.962425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad669afc-e45f-4ced-bc1a-3682ddfa56a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:06.964058 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad669afc-e45f-4ced-bc1a-3682ddfa56a2 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:06.976682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1228/2439] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:08.359210 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871e5ed-7a65-418c-b448-352a1cad1bbc None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:08.359742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871e5ed-7a65-418c-b448-352a1cad1bbc None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:08.359742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871e5ed-7a65-418c-b448-352a1cad1bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:08.377835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7871e5ed-7a65-418c-b448-352a1cad1bbc None None] MFA Rules not processed for user `8f3f0264d71f49ff98d477bdfacf530d`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:08.379056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7871e5ed-7a65-418c-b448-352a1cad1bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:08.386400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1212/2440] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:08.633799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad669afc-e45f-4ced-bc1a-3682ddfa56a2 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:08.635325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ad669afc-e45f-4ced-bc1a-3682ddfa56a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:08.679832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:08.695244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad669afc-e45f-4ced-bc1a-3682ddfa56a2 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:08.699213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263390b9-69d9-48ea-9cb3-c1d4e68f1fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:08.699806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263390b9-69d9-48ea-9cb3-c1d4e68f1fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:08.700738 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263390b9-69d9-48ea-9cb3-c1d4e68f1fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:08.701040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263390b9-69d9-48ea-9cb3-c1d4e68f1fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:08.702953 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-263390b9-69d9-48ea-9cb3-c1d4e68f1fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:08.712645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263390b9-69d9-48ea-9cb3-c1d4e68f1fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:08.714170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263390b9-69d9-48ea-9cb3-c1d4e68f1fe6 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:08.723316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1229/2441] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:09.050620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871e5ed-7a65-418c-b448-352a1cad1bbc None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:09.052289 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7871e5ed-7a65-418c-b448-352a1cad1bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:09.123318 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:09.129943 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871e5ed-7a65-418c-b448-352a1cad1bbc None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:09.135027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46781a95-29cc-4844-947e-167ff3ab41f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8048235c6421eae12ca99f80ed5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:09.135682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781a95-29cc-4844-947e-167ff3ab41f4 service placement] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:09.135967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781a95-29cc-4844-947e-167ff3ab41f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:09.136240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781a95-29cc-4844-947e-167ff3ab41f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:09.138104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-46781a95-29cc-4844-947e-167ff3ab41f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:09.149638 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46781a95-29cc-4844-947e-167ff3ab41f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:09.151245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46781a95-29cc-4844-947e-167ff3ab41f4 service placement] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:09.161140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1213/2442] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:23:11.014276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263390b9-69d9-48ea-9cb3-c1d4e68f1fe6 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:11.024788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263390b9-69d9-48ea-9cb3-c1d4e68f1fe6 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:11.029382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8301921-50ad-4749-8bfb-b920a082391f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:11.030267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8301921-50ad-4749-8bfb-b920a082391f service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:11.030560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8301921-50ad-4749-8bfb-b920a082391f service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:11.030833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8301921-50ad-4749-8bfb-b920a082391f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:11.032924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c8301921-50ad-4749-8bfb-b920a082391f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:11.044005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8301921-50ad-4749-8bfb-b920a082391f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:11.045642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8301921-50ad-4749-8bfb-b920a082391f service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:11.054989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1230/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:17.732167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46781a95-29cc-4844-947e-167ff3ab41f4 service placement] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:17.735290 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-46781a95-29cc-4844-947e-167ff3ab41f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:17.839956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46781a95-29cc-4844-947e-167ff3ab41f4 service placement] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:17.846040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2f6af-2517-465a-b691-9112f4eb987b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:17.846793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2f6af-2517-465a-b691-9112f4eb987b service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:17.847076 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2f6af-2517-465a-b691-9112f4eb987b service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:17.847348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2f6af-2517-465a-b691-9112f4eb987b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:17.849124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bab2f6af-2517-465a-b691-9112f4eb987b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:17.861678 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2f6af-2517-465a-b691-9112f4eb987b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:17.863305 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2f6af-2517-465a-b691-9112f4eb987b service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:17.882491 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1214/2444] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:21.054536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=14 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:21.919932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8301921-50ad-4749-8bfb-b920a082391f service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:21.997607 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8301921-50ad-4749-8bfb-b920a082391f service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:22.002637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:22.003535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:22.003861 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:22.004119 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] PATH_INFO: `/v3/users/7c9cc4c806e241638d711ff179beb965` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:22.005302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9cc4c806e241638d711ff179beb965)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:22.007324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:22.065047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9cc4c806e241638d711ff179beb965'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.065985 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9cc4c806e241638d711ff179beb965'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.075375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9cc4c806e241638d711ff179beb965'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.088751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9cc4c806e241638d711ff179beb965'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.096676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9cc4c806e241638d711ff179beb965'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.103937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1231/2445] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:21 2022] DELETE /identity/v3/users/7c9cc4c806e241638d711ff179beb965 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:22.109008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c3fa-d00d-4694-a04a-14ec29c8ed0a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:22.109832 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c3fa-d00d-4694-a04a-14ec29c8ed0a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:22.109832 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c3fa-d00d-4694-a04a-14ec29c8ed0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:22.129655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-b324c3fa-d00d-4694-a04a-14ec29c8ed0a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:22.130899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b324c3fa-d00d-4694-a04a-14ec29c8ed0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:22.198753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1215/2446] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:22.208480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:22.209877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:22.271350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de95874-35e1-4b51-af7f-1ed39dcc79c2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:22.274897 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125d6c-cc54-4748-b9ac-9b173ff4f426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:22.275548 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125d6c-cc54-4748-b9ac-9b173ff4f426 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:22.275831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125d6c-cc54-4748-b9ac-9b173ff4f426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:22.276096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125d6c-cc54-4748-b9ac-9b173ff4f426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:22.285178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b125d6c-cc54-4748-b9ac-9b173ff4f426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:22.286697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b125d6c-cc54-4748-b9ac-9b173ff4f426 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:22.296195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1232/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:22.660528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c3fa-d00d-4694-a04a-14ec29c8ed0a None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:22.662270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b324c3fa-d00d-4694-a04a-14ec29c8ed0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:22.692721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c3fa-d00d-4694-a04a-14ec29c8ed0a None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:22.698120 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:22.699041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:22.699319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:22.699588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] PATH_INFO: `/v3/projects/e1162f117f8b4240a4f3d967435b56dc` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:22.700960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1162f117f8b4240a4f3d967435b56dc)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:22.702919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:22.753337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1162f117f8b4240a4f3d967435b56dc', 'request_id': 'req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.760445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1162f117f8b4240a4f3d967435b56dc', 'request_id': 'req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.770104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1162f117f8b4240a4f3d967435b56dc', 'request_id': 'req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.777136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:22.782438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] The token cache is being invalidate because project e1162f117f8b4240a4f3d967435b56dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:22.782794 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.783683 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.785654 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1216/2448] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:22 2022] DELETE /identity/v3/projects/e1162f117f8b4240a4f3d967435b56dc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:22.789707 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125d6c-cc54-4748-b9ac-9b173ff4f426 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:22.800283 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125d6c-cc54-4748-b9ac-9b173ff4f426 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:22.819577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:22.862251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73c20-25aa-4bb1-bd3c-43288dcd2090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:22.863046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73c20-25aa-4bb1-bd3c-43288dcd2090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:22.863326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73c20-25aa-4bb1-bd3c-43288dcd2090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:22.863598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73c20-25aa-4bb1-bd3c-43288dcd2090 admin admin] PATH_INFO: `/v3/users/38ea6ef46d8f4932b53ca5416ae4f5ed` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:22.864942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73c20-25aa-4bb1-bd3c-43288dcd2090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ea6ef46d8f4932b53ca5416ae4f5ed)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:22.867184 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73c20-25aa-4bb1-bd3c-43288dcd2090 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:22.920998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c5c73c20-25aa-4bb1-bd3c-43288dcd2090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ea6ef46d8f4932b53ca5416ae4f5ed'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.921648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c5c73c20-25aa-4bb1-bd3c-43288dcd2090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ea6ef46d8f4932b53ca5416ae4f5ed'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.936114 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c5c73c20-25aa-4bb1-bd3c-43288dcd2090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ea6ef46d8f4932b53ca5416ae4f5ed'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.950575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c5c73c20-25aa-4bb1-bd3c-43288dcd2090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ea6ef46d8f4932b53ca5416ae4f5ed'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.957634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c5c73c20-25aa-4bb1-bd3c-43288dcd2090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ea6ef46d8f4932b53ca5416ae4f5ed'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:22.963659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1233/2449] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:22 2022] DELETE /identity/v3/users/38ea6ef46d8f4932b53ca5416ae4f5ed => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:23.275279 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:23.277672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:23.301127 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a536a5-8bcf-4665-ba86-cbf49a3f3590 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:23.399668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:23.400660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:23.400942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:23.401216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] PATH_INFO: `/v3/projects/29385a9eb1674aba93508b1fe8920ead` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:23.402531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29385a9eb1674aba93508b1fe8920ead)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:23.404581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:23.487482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29385a9eb1674aba93508b1fe8920ead', 'request_id': 'req-822c76ae-c42e-4479-aa70-86306d33e548'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:23.493827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29385a9eb1674aba93508b1fe8920ead', 'request_id': 'req-822c76ae-c42e-4479-aa70-86306d33e548'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:23.501795 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29385a9eb1674aba93508b1fe8920ead', 'request_id': 'req-822c76ae-c42e-4479-aa70-86306d33e548'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:23.513324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] The token cache is being invalidate because project 29385a9eb1674aba93508b1fe8920ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:23.513714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:23.514458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-822c76ae-c42e-4479-aa70-86306d33e548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:23.516091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1217/2450] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:23 2022] DELETE /identity/v3/projects/29385a9eb1674aba93508b1fe8920ead => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:23.521214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e87531-1e6f-42af-a497-d13e8837ad0f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:23.521721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e87531-1e6f-42af-a497-d13e8837ad0f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:23.521721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e87531-1e6f-42af-a497-d13e8837ad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:23.540552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c3e87531-1e6f-42af-a497-d13e8837ad0f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:23.541788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c3e87531-1e6f-42af-a497-d13e8837ad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:23.607203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1234/2451] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:23.615812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af405b42-7751-4e4c-bbdf-1f0d600c9668 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:23.616244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af405b42-7751-4e4c-bbdf-1f0d600c9668 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:23.616607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af405b42-7751-4e4c-bbdf-1f0d600c9668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:23.648496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-af405b42-7751-4e4c-bbdf-1f0d600c9668 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:23.649725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-af405b42-7751-4e4c-bbdf-1f0d600c9668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:23.658502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1218/2452] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:23.662990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e87531-1e6f-42af-a497-d13e8837ad0f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:23.673868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e87531-1e6f-42af-a497-d13e8837ad0f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:23.679489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2fb66-ae9d-42d2-8c4f-9edc029cb8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:23.680257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2fb66-ae9d-42d2-8c4f-9edc029cb8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:23.680602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2fb66-ae9d-42d2-8c4f-9edc029cb8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:23.680942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2fb66-ae9d-42d2-8c4f-9edc029cb8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:23.681751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2fb66-ae9d-42d2-8c4f-9edc029cb8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:23:23.682137 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2fb66-ae9d-42d2-8c4f-9edc029cb8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:23.683912 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2fb66-ae9d-42d2-8c4f-9edc029cb8f8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:23.698820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1235/2453] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:23:23.705647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af405b42-7751-4e4c-bbdf-1f0d600c9668 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:23.715703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af405b42-7751-4e4c-bbdf-1f0d600c9668 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:23.722729 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1958a65-04c9-4739-b052-c77c4cf0f537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:23.723421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1958a65-04c9-4739-b052-c77c4cf0f537 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:23.723687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1958a65-04c9-4739-b052-c77c4cf0f537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:23.723959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1958a65-04c9-4739-b052-c77c4cf0f537 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:23.724659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1958a65-04c9-4739-b052-c77c4cf0f537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:23.726634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1958a65-04c9-4739-b052-c77c4cf0f537 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:23.759889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1219/2454] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:23 2022] POST /identity/v3/projects => generated 361 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:23.764089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2fb66-ae9d-42d2-8c4f-9edc029cb8f8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:23.776969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2fb66-ae9d-42d2-8c4f-9edc029cb8f8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:23.811288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:23.863767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4badd68-8a37-4ce4-a9e5-0732a20aee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:23.864602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4badd68-8a37-4ce4-a9e5-0732a20aee7e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:23.865118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4badd68-8a37-4ce4-a9e5-0732a20aee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:23.865118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4badd68-8a37-4ce4-a9e5-0732a20aee7e admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:23.865838 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4badd68-8a37-4ce4-a9e5-0732a20aee7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:23.867865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4badd68-8a37-4ce4-a9e5-0732a20aee7e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:23.891364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1236/2455] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:23 2022] POST /identity/v3/users => generated 281 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:23.896408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1958a65-04c9-4739-b052-c77c4cf0f537 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:23.908315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1958a65-04c9-4739-b052-c77c4cf0f537 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:23.913928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45413fb-49e0-4e99-af71-035d598874f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:23.914636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45413fb-49e0-4e99-af71-035d598874f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:23.914921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45413fb-49e0-4e99-af71-035d598874f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:23.915196 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45413fb-49e0-4e99-af71-035d598874f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:23.915937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45413fb-49e0-4e99-af71-035d598874f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:23.917609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45413fb-49e0-4e99-af71-035d598874f2 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:23.928889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1220/2456] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:23.933503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4badd68-8a37-4ce4-a9e5-0732a20aee7e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:23.944706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4badd68-8a37-4ce4-a9e5-0732a20aee7e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:23.949727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de75a4-469f-4076-8892-8a9f60058569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:23.950423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de75a4-469f-4076-8892-8a9f60058569 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:23.950704 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de75a4-469f-4076-8892-8a9f60058569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:23.950980 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de75a4-469f-4076-8892-8a9f60058569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:23.951712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de75a4-469f-4076-8892-8a9f60058569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:23.953329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de75a4-469f-4076-8892-8a9f60058569 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:23.964815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1237/2457] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:23.969559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45413fb-49e0-4e99-af71-035d598874f2 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:23.980344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45413fb-49e0-4e99-af71-035d598874f2 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:23.985229 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29809c-3032-4624-9fc5-73da30f80769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:23.986123 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29809c-3032-4624-9fc5-73da30f80769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:23.986446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29809c-3032-4624-9fc5-73da30f80769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:23.986818 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29809c-3032-4624-9fc5-73da30f80769 admin admin] PATH_INFO: `/v3/projects/76912b8d605540fbbaa66e9a012c4866/users/4a8243bbd13b46daae3ad3b1585e68cc/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.002284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29809c-3032-4624-9fc5-73da30f80769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76912b8d605540fbbaa66e9a012c4866, user_id=4a8243bbd13b46daae3ad3b1585e68cc, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:24.005532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29809c-3032-4624-9fc5-73da30f80769 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:24.021068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1221/2458] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:23 2022] PUT /identity/v3/projects/76912b8d605540fbbaa66e9a012c4866/users/4a8243bbd13b46daae3ad3b1585e68cc/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:24.031674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8a4b7-8f64-4a8f-b527-1eee9926053e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:24.031963 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8a4b7-8f64-4a8f-b527-1eee9926053e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:24.032255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8a4b7-8f64-4a8f-b527-1eee9926053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.062899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-21d8a4b7-8f64-4a8f-b527-1eee9926053e None None] MFA Rules not processed for user `4a8243bbd13b46daae3ad3b1585e68cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:24.064101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-21d8a4b7-8f64-4a8f-b527-1eee9926053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:24.136330 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1238/2459] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:24.140955 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29809c-3032-4624-9fc5-73da30f80769 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:24.170618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:24.208573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29809c-3032-4624-9fc5-73da30f80769 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:24.213895 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b192-b301-4273-8fe3-c6b3aa0a62c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:24.214619 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b192-b301-4273-8fe3-c6b3aa0a62c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:24.214903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b192-b301-4273-8fe3-c6b3aa0a62c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:24.215172 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b192-b301-4273-8fe3-c6b3aa0a62c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.215869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b192-b301-4273-8fe3-c6b3aa0a62c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:24.218166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b192-b301-4273-8fe3-c6b3aa0a62c6 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:24.255364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1222/2460] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:24 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:24.257062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8a4b7-8f64-4a8f-b527-1eee9926053e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:24.268792 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8a4b7-8f64-4a8f-b527-1eee9926053e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:24.331711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b62ae-ed47-4f1f-8f69-ca110b264df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:24.332400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b62ae-ed47-4f1f-8f69-ca110b264df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:24.332679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b62ae-ed47-4f1f-8f69-ca110b264df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:24.332951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b62ae-ed47-4f1f-8f69-ca110b264df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.333641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b62ae-ed47-4f1f-8f69-ca110b264df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:24.335628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b62ae-ed47-4f1f-8f69-ca110b264df0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:24.359129 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1239/2461] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:24 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:24.363243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b192-b301-4273-8fe3-c6b3aa0a62c6 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:24.374142 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b192-b301-4273-8fe3-c6b3aa0a62c6 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:24.379072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1591942-7de3-42a5-88b9-48132cc2ae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:24.379743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1591942-7de3-42a5-88b9-48132cc2ae03 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:24.380027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1591942-7de3-42a5-88b9-48132cc2ae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:24.380303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1591942-7de3-42a5-88b9-48132cc2ae03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.381044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1591942-7de3-42a5-88b9-48132cc2ae03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:24.382695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1591942-7de3-42a5-88b9-48132cc2ae03 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:24.394111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1223/2462] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:24.398193 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b62ae-ed47-4f1f-8f69-ca110b264df0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:24.409006 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b62ae-ed47-4f1f-8f69-ca110b264df0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:24.414677 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2e92f-4141-41ba-bdad-f7ac59c2565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:24.415623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e92f-4141-41ba-bdad-f7ac59c2565b admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:24.415948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e92f-4141-41ba-bdad-f7ac59c2565b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:24.416224 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e92f-4141-41ba-bdad-f7ac59c2565b admin admin] PATH_INFO: `/v3/projects/6645eb56c9be45c7a895dd50365cf234/users/cdf99f7e4cbb4717a6baf0f6d867fb46/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.438878 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2e92f-4141-41ba-bdad-f7ac59c2565b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6645eb56c9be45c7a895dd50365cf234, user_id=cdf99f7e4cbb4717a6baf0f6d867fb46, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:24.441629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2e92f-4141-41ba-bdad-f7ac59c2565b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:24.457513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1240/2463] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:24 2022] PUT /identity/v3/projects/6645eb56c9be45c7a895dd50365cf234/users/cdf99f7e4cbb4717a6baf0f6d867fb46/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:24.467578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1591942-7de3-42a5-88b9-48132cc2ae03 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:24.482063 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1591942-7de3-42a5-88b9-48132cc2ae03 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:24.553533 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75951143-9046-46b9-90b6-f3b93f461f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:24.554215 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75951143-9046-46b9-90b6-f3b93f461f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:24.554616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75951143-9046-46b9-90b6-f3b93f461f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:24.554792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75951143-9046-46b9-90b6-f3b93f461f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.555550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75951143-9046-46b9-90b6-f3b93f461f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:24.557146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75951143-9046-46b9-90b6-f3b93f461f57 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:24.568631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1224/2464] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:24.572930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2e92f-4141-41ba-bdad-f7ac59c2565b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:24.578457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:24.585256 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2e92f-4141-41ba-bdad-f7ac59c2565b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:24.593782 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c0197-f027-4cce-90e2-cb18fa2d77e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:24.594886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c0197-f027-4cce-90e2-cb18fa2d77e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:24.595169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c0197-f027-4cce-90e2-cb18fa2d77e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:24.595437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c0197-f027-4cce-90e2-cb18fa2d77e9 admin admin] PATH_INFO: `/v3/projects/6645eb56c9be45c7a895dd50365cf234/users/cdf99f7e4cbb4717a6baf0f6d867fb46/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.597527 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75951143-9046-46b9-90b6-f3b93f461f57 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:24.598362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c0197-f027-4cce-90e2-cb18fa2d77e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6645eb56c9be45c7a895dd50365cf234, user_id=cdf99f7e4cbb4717a6baf0f6d867fb46, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:24.599520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-75951143-9046-46b9-90b6-f3b93f461f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:24.601311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c0197-f027-4cce-90e2-cb18fa2d77e9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:24.613435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1241/2465] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:24 2022] PUT /identity/v3/projects/6645eb56c9be45c7a895dd50365cf234/users/cdf99f7e4cbb4717a6baf0f6d867fb46/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:24.625987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2200d96-a30b-4bea-8005-56221bebd5b0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:24.626281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2200d96-a30b-4bea-8005-56221bebd5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:24.626581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2200d96-a30b-4bea-8005-56221bebd5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.654493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e2200d96-a30b-4bea-8005-56221bebd5b0 None None] MFA Rules not processed for user `cdf99f7e4cbb4717a6baf0f6d867fb46`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:24.655691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e2200d96-a30b-4bea-8005-56221bebd5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:24.660272 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75951143-9046-46b9-90b6-f3b93f461f57 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:24.710352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f50c9f-ee0c-453d-b0a9-01ef32e64a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:24.711018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f50c9f-ee0c-453d-b0a9-01ef32e64a7b service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:24.711435 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f50c9f-ee0c-453d-b0a9-01ef32e64a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:24.711704 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f50c9f-ee0c-453d-b0a9-01ef32e64a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.713467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b8f50c9f-ee0c-453d-b0a9-01ef32e64a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:24.718746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:24.728385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1242/2466] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:24.740259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2200d96-a30b-4bea-8005-56221bebd5b0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:24.741659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e2200d96-a30b-4bea-8005-56221bebd5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:24.786569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f50c9f-ee0c-453d-b0a9-01ef32e64a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:24.788031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f50c9f-ee0c-453d-b0a9-01ef32e64a7b service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:24.798220 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1225/2467] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:23:24.801493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2200d96-a30b-4bea-8005-56221bebd5b0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:24.805221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bd1f7-8ca8-44a8-a6cd-7f354be2e18d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:24.805887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bd1f7-8ca8-44a8-a6cd-7f354be2e18d service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:24.806169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bd1f7-8ca8-44a8-a6cd-7f354be2e18d service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:24.806479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bd1f7-8ca8-44a8-a6cd-7f354be2e18d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.816106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bd1f7-8ca8-44a8-a6cd-7f354be2e18d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:24.817561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bd1f7-8ca8-44a8-a6cd-7f354be2e18d service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:24.827810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1243/2468] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:23:24.915304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f50c9f-ee0c-453d-b0a9-01ef32e64a7b service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:24.926528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f50c9f-ee0c-453d-b0a9-01ef32e64a7b service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:24.932628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f760a-4567-4778-8c0f-6373d334bf20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:24.933380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f760a-4567-4778-8c0f-6373d334bf20 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:24.933722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f760a-4567-4778-8c0f-6373d334bf20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:24.934058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f760a-4567-4778-8c0f-6373d334bf20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:24.999242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f760a-4567-4778-8c0f-6373d334bf20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:25.000697 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f760a-4567-4778-8c0f-6373d334bf20 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:25.010020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1226/2469] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:28.336173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bd1f7-8ca8-44a8-a6cd-7f354be2e18d service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:28.337712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4c5bd1f7-8ca8-44a8-a6cd-7f354be2e18d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:28.358611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bd1f7-8ca8-44a8-a6cd-7f354be2e18d service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:28.363381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cda32-4cb4-4db4-9fcc-733aa38aa94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:28.364298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cda32-4cb4-4db4-9fcc-733aa38aa94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:28.364575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cda32-4cb4-4db4-9fcc-733aa38aa94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:28.364844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cda32-4cb4-4db4-9fcc-733aa38aa94b admin admin] PATH_INFO: `/v3/users/1dd219b5b23c454c8279169367d23e6e` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:28.366021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cda32-4cb4-4db4-9fcc-733aa38aa94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd219b5b23c454c8279169367d23e6e)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:28.367986 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cda32-4cb4-4db4-9fcc-733aa38aa94b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:28.415640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-456cda32-4cb4-4db4-9fcc-733aa38aa94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd219b5b23c454c8279169367d23e6e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:28.416338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-456cda32-4cb4-4db4-9fcc-733aa38aa94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd219b5b23c454c8279169367d23e6e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:28.424163 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-456cda32-4cb4-4db4-9fcc-733aa38aa94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd219b5b23c454c8279169367d23e6e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:28.437127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-456cda32-4cb4-4db4-9fcc-733aa38aa94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd219b5b23c454c8279169367d23e6e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:28.438341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:28.447566 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-456cda32-4cb4-4db4-9fcc-733aa38aa94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd219b5b23c454c8279169367d23e6e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:28.463031 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1244/2470] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:28 2022] DELETE /identity/v3/users/1dd219b5b23c454c8279169367d23e6e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:28.642625 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f760a-4567-4778-8c0f-6373d334bf20 service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:28.654597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f760a-4567-4778-8c0f-6373d334bf20 service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:28.723712 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:28.724717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:28.725104 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:28.725472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] PATH_INFO: `/v3/projects/dd229ab2591a4bb9a7550617d803e741` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:28.726809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd229ab2591a4bb9a7550617d803e741)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:28.729056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:28.780559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:28.787879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd229ab2591a4bb9a7550617d803e741', 'request_id': 'req-52be9f61-0233-41a3-9ba6-46c0a6051c80'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:28.794492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd229ab2591a4bb9a7550617d803e741', 'request_id': 'req-52be9f61-0233-41a3-9ba6-46c0a6051c80'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:28.802863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd229ab2591a4bb9a7550617d803e741', 'request_id': 'req-52be9f61-0233-41a3-9ba6-46c0a6051c80'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:28.816379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] The token cache is being invalidate because project dd229ab2591a4bb9a7550617d803e741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:28.816808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:28.817839 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-52be9f61-0233-41a3-9ba6-46c0a6051c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:28.819669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1227/2471] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:28 2022] DELETE /identity/v3/projects/dd229ab2591a4bb9a7550617d803e741 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:28.825106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07102382-8cdd-488c-a74e-eb21d53f88a1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:28.825603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07102382-8cdd-488c-a74e-eb21d53f88a1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:28.826053 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07102382-8cdd-488c-a74e-eb21d53f88a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:28.846487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-07102382-8cdd-488c-a74e-eb21d53f88a1 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:28.847801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-07102382-8cdd-488c-a74e-eb21d53f88a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:28.907186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1245/2472] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:28.916363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f5c53-ccd6-42c8-a3ed-33986ebc355d None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:28.916732 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f5c53-ccd6-42c8-a3ed-33986ebc355d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:28.917060 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f5c53-ccd6-42c8-a3ed-33986ebc355d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:28.943588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-509f5c53-ccd6-42c8-a3ed-33986ebc355d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:28.944919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-509f5c53-ccd6-42c8-a3ed-33986ebc355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:28.953843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1228/2473] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:28.958634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07102382-8cdd-488c-a74e-eb21d53f88a1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:28.969466 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07102382-8cdd-488c-a74e-eb21d53f88a1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:28.974587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f2add-682d-4026-a131-9fd4c1b296cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:28.975263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f2add-682d-4026-a131-9fd4c1b296cc admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:28.975540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f2add-682d-4026-a131-9fd4c1b296cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:28.975816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f2add-682d-4026-a131-9fd4c1b296cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:28.976584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f2add-682d-4026-a131-9fd4c1b296cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:23:28.976900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f2add-682d-4026-a131-9fd4c1b296cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:28.978581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f2add-682d-4026-a131-9fd4c1b296cc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:28.991272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1246/2474] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:23:28.995946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f5c53-ccd6-42c8-a3ed-33986ebc355d None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:29.005843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f5c53-ccd6-42c8-a3ed-33986ebc355d None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:29.011346 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749f2d1-6c42-4428-ac0d-a9447bc38c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:29.012094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f2d1-6c42-4428-ac0d-a9447bc38c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.012291 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f2d1-6c42-4428-ac0d-a9447bc38c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.012560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f2d1-6c42-4428-ac0d-a9447bc38c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.013254 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749f2d1-6c42-4428-ac0d-a9447bc38c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:29.015251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749f2d1-6c42-4428-ac0d-a9447bc38c9a admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:29.055184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1229/2475] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:28 2022] POST /identity/v3/projects => generated 361 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:29.059443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f2add-682d-4026-a131-9fd4c1b296cc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:29.071036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f2add-682d-4026-a131-9fd4c1b296cc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:29.132120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33762921-9c69-4d7c-9d21-a3bf349dbd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:29.132847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33762921-9c69-4d7c-9d21-a3bf349dbd1e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.133115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33762921-9c69-4d7c-9d21-a3bf349dbd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.133389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33762921-9c69-4d7c-9d21-a3bf349dbd1e admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.134117 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33762921-9c69-4d7c-9d21-a3bf349dbd1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:29.136104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33762921-9c69-4d7c-9d21-a3bf349dbd1e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:29.162907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1247/2476] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:29 2022] POST /identity/v3/users => generated 281 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:29.164501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749f2d1-6c42-4428-ac0d-a9447bc38c9a admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:29.176433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749f2d1-6c42-4428-ac0d-a9447bc38c9a admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:29.181626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e713dcb-e59e-4810-99b5-83bad23be551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:29.182487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e713dcb-e59e-4810-99b5-83bad23be551 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.182791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e713dcb-e59e-4810-99b5-83bad23be551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.183066 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e713dcb-e59e-4810-99b5-83bad23be551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.183803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e713dcb-e59e-4810-99b5-83bad23be551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:29.185464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e713dcb-e59e-4810-99b5-83bad23be551 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:29.198369 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1230/2477] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:23:29.201529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33762921-9c69-4d7c-9d21-a3bf349dbd1e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:29.212314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33762921-9c69-4d7c-9d21-a3bf349dbd1e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:29.218019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cc68b-ca01-4b3b-b1bb-d55a5f26071b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:29.218719 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cc68b-ca01-4b3b-b1bb-d55a5f26071b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.218997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cc68b-ca01-4b3b-b1bb-d55a5f26071b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.219267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cc68b-ca01-4b3b-b1bb-d55a5f26071b admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.220028 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cc68b-ca01-4b3b-b1bb-d55a5f26071b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:29.222132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cc68b-ca01-4b3b-b1bb-d55a5f26071b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:29.232972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1248/2478] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:29.237592 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e713dcb-e59e-4810-99b5-83bad23be551 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:29.250483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e713dcb-e59e-4810-99b5-83bad23be551 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:29.256370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326a9f5-7ea3-4328-8fa2-8e4de7cb893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:29.257307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326a9f5-7ea3-4328-8fa2-8e4de7cb893d admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.257581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326a9f5-7ea3-4328-8fa2-8e4de7cb893d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.257849 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326a9f5-7ea3-4328-8fa2-8e4de7cb893d admin admin] PATH_INFO: `/v3/projects/609234331bdf4e599bbc73a83b617793/users/2d4fb05f20f1495d96876d9b20005b03/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.274456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326a9f5-7ea3-4328-8fa2-8e4de7cb893d admin admin] RBAC: Authorizing `identity:create_grant(project_id=609234331bdf4e599bbc73a83b617793, user_id=2d4fb05f20f1495d96876d9b20005b03, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:29.277163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326a9f5-7ea3-4328-8fa2-8e4de7cb893d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:29.293011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1231/2479] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:29 2022] PUT /identity/v3/projects/609234331bdf4e599bbc73a83b617793/users/2d4fb05f20f1495d96876d9b20005b03/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:29.304348 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e04d4a-4815-4234-902e-6d6eb6de70df None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.304635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e04d4a-4815-4234-902e-6d6eb6de70df None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.304908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e04d4a-4815-4234-902e-6d6eb6de70df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.338320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d9e04d4a-4815-4234-902e-6d6eb6de70df None None] MFA Rules not processed for user `2d4fb05f20f1495d96876d9b20005b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:29.339533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d9e04d4a-4815-4234-902e-6d6eb6de70df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:29.387442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:29.413736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1249/2480] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:29.418565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326a9f5-7ea3-4328-8fa2-8e4de7cb893d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:29.488942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326a9f5-7ea3-4328-8fa2-8e4de7cb893d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:29.493986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618939e-208e-4617-9a2c-11bb6c99577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:29.494706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618939e-208e-4617-9a2c-11bb6c99577f admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.494997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618939e-208e-4617-9a2c-11bb6c99577f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.495262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618939e-208e-4617-9a2c-11bb6c99577f admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.496013 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618939e-208e-4617-9a2c-11bb6c99577f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:29.499731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618939e-208e-4617-9a2c-11bb6c99577f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:29.530679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1232/2481] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:29 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:29.535104 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e04d4a-4815-4234-902e-6d6eb6de70df None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:29.546901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e04d4a-4815-4234-902e-6d6eb6de70df None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:29.609796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78498b-e427-464d-b12c-b75ff3f2128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:29.610580 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78498b-e427-464d-b12c-b75ff3f2128e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.610977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78498b-e427-464d-b12c-b75ff3f2128e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.611312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78498b-e427-464d-b12c-b75ff3f2128e admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.612229 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78498b-e427-464d-b12c-b75ff3f2128e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:29.614351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78498b-e427-464d-b12c-b75ff3f2128e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:29.635625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1250/2482] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:29 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:29.639564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618939e-208e-4617-9a2c-11bb6c99577f admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:29.650027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618939e-208e-4617-9a2c-11bb6c99577f admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:29.654846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ca0e4-93f0-4896-acfe-096ceb13eed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:29.655597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ca0e4-93f0-4896-acfe-096ceb13eed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.655877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ca0e4-93f0-4896-acfe-096ceb13eed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.656146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ca0e4-93f0-4896-acfe-096ceb13eed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.656879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ca0e4-93f0-4896-acfe-096ceb13eed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:29.658559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ca0e4-93f0-4896-acfe-096ceb13eed1 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:29.671458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1233/2483] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:29.675850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78498b-e427-464d-b12c-b75ff3f2128e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:29.688557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78498b-e427-464d-b12c-b75ff3f2128e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:29.694334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa15b6e-1c38-4143-a656-34c90848fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:29.695292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa15b6e-1c38-4143-a656-34c90848fdf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.695575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa15b6e-1c38-4143-a656-34c90848fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.695854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa15b6e-1c38-4143-a656-34c90848fdf2 admin admin] PATH_INFO: `/v3/projects/57dfaf1a7bf641c6aca252eba73974b0/users/760847b3364842f99dba81f622ff5559/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.714832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa15b6e-1c38-4143-a656-34c90848fdf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57dfaf1a7bf641c6aca252eba73974b0, user_id=760847b3364842f99dba81f622ff5559, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:29.717868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa15b6e-1c38-4143-a656-34c90848fdf2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:29.731334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1251/2484] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:29 2022] PUT /identity/v3/projects/57dfaf1a7bf641c6aca252eba73974b0/users/760847b3364842f99dba81f622ff5559/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:29.735528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ca0e4-93f0-4896-acfe-096ceb13eed1 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:29.750258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ca0e4-93f0-4896-acfe-096ceb13eed1 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:29.789392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:29.823957 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce60762-b893-4087-a48d-717c5f42f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:29.824692 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce60762-b893-4087-a48d-717c5f42f632 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.824968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce60762-b893-4087-a48d-717c5f42f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.825232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce60762-b893-4087-a48d-717c5f42f632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.825986 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce60762-b893-4087-a48d-717c5f42f632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:29.827779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce60762-b893-4087-a48d-717c5f42f632 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:29.843900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1234/2485] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:23:29.845000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa15b6e-1c38-4143-a656-34c90848fdf2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:29.855972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa15b6e-1c38-4143-a656-34c90848fdf2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:29.860554 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79145807-af3a-4f0a-8606-8cc6168bc200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:29.861559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79145807-af3a-4f0a-8606-8cc6168bc200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.861894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79145807-af3a-4f0a-8606-8cc6168bc200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.862166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79145807-af3a-4f0a-8606-8cc6168bc200 admin admin] PATH_INFO: `/v3/projects/57dfaf1a7bf641c6aca252eba73974b0/users/760847b3364842f99dba81f622ff5559/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.864321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79145807-af3a-4f0a-8606-8cc6168bc200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57dfaf1a7bf641c6aca252eba73974b0, user_id=760847b3364842f99dba81f622ff5559, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:29.867016 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79145807-af3a-4f0a-8606-8cc6168bc200 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:29.881319 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1252/2486] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:29 2022] PUT /identity/v3/projects/57dfaf1a7bf641c6aca252eba73974b0/users/760847b3364842f99dba81f622ff5559/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:29.891519 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c89c1-a0dd-4b7f-89d6-29a6cd96f2ae None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:29.891799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c89c1-a0dd-4b7f-89d6-29a6cd96f2ae None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:29.892069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c89c1-a0dd-4b7f-89d6-29a6cd96f2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:29.925425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-3c1c89c1-a0dd-4b7f-89d6-29a6cd96f2ae None None] MFA Rules not processed for user `760847b3364842f99dba81f622ff5559`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:29.926897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3c1c89c1-a0dd-4b7f-89d6-29a6cd96f2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:30.003385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1235/2487] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:30.015033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79145807-af3a-4f0a-8606-8cc6168bc200 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:30.016850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-79145807-af3a-4f0a-8606-8cc6168bc200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:30.079048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79145807-af3a-4f0a-8606-8cc6168bc200 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:30.082804 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10604dc-3e94-4095-8163-ceca9362e7fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:30.083470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10604dc-3e94-4095-8163-ceca9362e7fc service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:30.083748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10604dc-3e94-4095-8163-ceca9362e7fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:30.084021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10604dc-3e94-4095-8163-ceca9362e7fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:30.094236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10604dc-3e94-4095-8163-ceca9362e7fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:30.095713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10604dc-3e94-4095-8163-ceca9362e7fc service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:30.105311 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1253/2488] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:30.179992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c89c1-a0dd-4b7f-89d6-29a6cd96f2ae None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:30.190058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c89c1-a0dd-4b7f-89d6-29a6cd96f2ae None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:30.194129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcdba6-8de6-4112-b0cb-16ef3230dc6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:30.194815 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcdba6-8de6-4112-b0cb-16ef3230dc6b service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:30.195093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcdba6-8de6-4112-b0cb-16ef3230dc6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:30.195364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcdba6-8de6-4112-b0cb-16ef3230dc6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:30.258463 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcdba6-8de6-4112-b0cb-16ef3230dc6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:30.259821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcdba6-8de6-4112-b0cb-16ef3230dc6b service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:30.270492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1236/2489] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:32.413175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10604dc-3e94-4095-8163-ceca9362e7fc service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:32.414788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e10604dc-3e94-4095-8163-ceca9362e7fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:32.459659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:32.483118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10604dc-3e94-4095-8163-ceca9362e7fc service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:32.487789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:32.488937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:32.489216 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:32.489485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] PATH_INFO: `/v3/users/4a8243bbd13b46daae3ad3b1585e68cc` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:32.490705 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8243bbd13b46daae3ad3b1585e68cc)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:32.492644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:32.544852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8243bbd13b46daae3ad3b1585e68cc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:32.545545 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8243bbd13b46daae3ad3b1585e68cc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:32.554038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8243bbd13b46daae3ad3b1585e68cc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:32.566478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8243bbd13b46daae3ad3b1585e68cc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:32.573805 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8243bbd13b46daae3ad3b1585e68cc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:32.580175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1254/2490] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:32 2022] DELETE /identity/v3/users/4a8243bbd13b46daae3ad3b1585e68cc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:32.584929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ef41-1f62-497b-956a-9cb98476d409 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:32.585441 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ef41-1f62-497b-956a-9cb98476d409 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:32.585538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ef41-1f62-497b-956a-9cb98476d409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:32.603253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-7c18ef41-1f62-497b-956a-9cb98476d409 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:32.604506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7c18ef41-1f62-497b-956a-9cb98476d409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:32.653558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:32.669448 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1237/2491] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:32.679630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:32.681083 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:32.742284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbcaf9-c35c-40d2-a407-c1d8e6532ebc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:32.746081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629e769-228f-42de-be7f-d45ac250dcf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:32.746760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629e769-228f-42de-be7f-d45ac250dcf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:32.747036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629e769-228f-42de-be7f-d45ac250dcf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:32.747303 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629e769-228f-42de-be7f-d45ac250dcf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:32.757882 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629e769-228f-42de-be7f-d45ac250dcf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:32.759367 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629e769-228f-42de-be7f-d45ac250dcf0 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:32.769276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1255/2492] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:33.049415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18ef41-1f62-497b-956a-9cb98476d409 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:33.049415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7c18ef41-1f62-497b-956a-9cb98476d409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:33.067765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18ef41-1f62-497b-956a-9cb98476d409 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:33.073631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbeb28-cd77-4e6b-a972-4366917ecdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:33.075026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbeb28-cd77-4e6b-a972-4366917ecdd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:33.075298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbeb28-cd77-4e6b-a972-4366917ecdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:33.075567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbeb28-cd77-4e6b-a972-4366917ecdd5 admin admin] PATH_INFO: `/v3/users/2d4fb05f20f1495d96876d9b20005b03` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:33.076232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629e769-228f-42de-be7f-d45ac250dcf0 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:33.076899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbeb28-cd77-4e6b-a972-4366917ecdd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4fb05f20f1495d96876d9b20005b03)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:33.078072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2629e769-228f-42de-be7f-d45ac250dcf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:33.079128 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbeb28-cd77-4e6b-a972-4366917ecdd5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:33.093279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629e769-228f-42de-be7f-d45ac250dcf0 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:33.098865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:33.099702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:33.099959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:33.100236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] PATH_INFO: `/v3/projects/76912b8d605540fbbaa66e9a012c4866` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:33.101773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76912b8d605540fbbaa66e9a012c4866)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:33.103799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:33.138376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-69fbeb28-cd77-4e6b-a972-4366917ecdd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4fb05f20f1495d96876d9b20005b03'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.139084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-69fbeb28-cd77-4e6b-a972-4366917ecdd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4fb05f20f1495d96876d9b20005b03'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.147453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-69fbeb28-cd77-4e6b-a972-4366917ecdd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4fb05f20f1495d96876d9b20005b03'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.154934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-69fbeb28-cd77-4e6b-a972-4366917ecdd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4fb05f20f1495d96876d9b20005b03'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.162189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76912b8d605540fbbaa66e9a012c4866', 'request_id': 'req-18248cde-d2ad-40d6-aeea-69c778733166'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.168697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76912b8d605540fbbaa66e9a012c4866', 'request_id': 'req-18248cde-d2ad-40d6-aeea-69c778733166'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.168902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-69fbeb28-cd77-4e6b-a972-4366917ecdd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4fb05f20f1495d96876d9b20005b03'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.171507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:33.179174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1238/2493] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:33 2022] DELETE /identity/v3/users/2d4fb05f20f1495d96876d9b20005b03 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:33.180899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a022d-ac49-49b9-9adb-2fac62056bdb None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:33.181046 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76912b8d605540fbbaa66e9a012c4866', 'request_id': 'req-18248cde-d2ad-40d6-aeea-69c778733166'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.181196 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a022d-ac49-49b9-9adb-2fac62056bdb None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:33.181485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a022d-ac49-49b9-9adb-2fac62056bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:33.193497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] The token cache is being invalidate because project 76912b8d605540fbbaa66e9a012c4866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:33.193784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.194449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.196203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1256/2494] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:33 2022] DELETE /identity/v3/projects/76912b8d605540fbbaa66e9a012c4866 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:33.199938 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:33.201176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8a5a022d-ac49-49b9-9adb-2fac62056bdb None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:33.201290 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:33.202370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8a5a022d-ac49-49b9-9adb-2fac62056bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:33.262550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1239/2495] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:33.266929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18248cde-d2ad-40d6-aeea-69c778733166 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:33.272211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a022d-ac49-49b9-9adb-2fac62056bdb None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:33.272359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:33.273146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:33.273542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8a5a022d-ac49-49b9-9adb-2fac62056bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:33.273759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:33.274059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] PATH_INFO: `/v3/users/cdf99f7e4cbb4717a6baf0f6d867fb46` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:33.275406 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf99f7e4cbb4717a6baf0f6d867fb46)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:33.277436 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:33.331343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf99f7e4cbb4717a6baf0f6d867fb46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.332032 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf99f7e4cbb4717a6baf0f6d867fb46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.337233 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a022d-ac49-49b9-9adb-2fac62056bdb None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:33.340410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf99f7e4cbb4717a6baf0f6d867fb46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.341150 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bc660-681b-40a5-842b-c0d45fb06d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:33.342179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc660-681b-40a5-842b-c0d45fb06d7d service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:33.342472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc660-681b-40a5-842b-c0d45fb06d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:33.342744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc660-681b-40a5-842b-c0d45fb06d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:33.353090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bc660-681b-40a5-842b-c0d45fb06d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:33.353254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf99f7e4cbb4717a6baf0f6d867fb46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.354569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bc660-681b-40a5-842b-c0d45fb06d7d service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:33.359979 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf99f7e4cbb4717a6baf0f6d867fb46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.364729 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1240/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:23:33.366730 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1257/2497] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:33 2022] DELETE /identity/v3/users/cdf99f7e4cbb4717a6baf0f6d867fb46 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:33.674559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bc660-681b-40a5-842b-c0d45fb06d7d service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:33.676162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-683bc660-681b-40a5-842b-c0d45fb06d7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:33.691146 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bc660-681b-40a5-842b-c0d45fb06d7d service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:33.705021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:33.771378 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:33.772546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:33.773047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:33.773453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:33.773741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:33.774013 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] PATH_INFO: `/v3/projects/609234331bdf4e599bbc73a83b617793` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:33.775253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609234331bdf4e599bbc73a83b617793)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:33.777229 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:33.789166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc87eda-0a29-4a6d-b8ea-601e538bc962 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:33.793699 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:33.795157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:33.795446 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:33.795899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] PATH_INFO: `/v3/projects/6645eb56c9be45c7a895dd50365cf234` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:33.797368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6645eb56c9be45c7a895dd50365cf234)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:33.799335 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:33.831323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609234331bdf4e599bbc73a83b617793', 'request_id': 'req-ca994692-4727-4930-914d-f55e384ba572'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.839401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609234331bdf4e599bbc73a83b617793', 'request_id': 'req-ca994692-4727-4930-914d-f55e384ba572'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.847289 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609234331bdf4e599bbc73a83b617793', 'request_id': 'req-ca994692-4727-4930-914d-f55e384ba572'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.850628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6645eb56c9be45c7a895dd50365cf234', 'request_id': 'req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.857485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6645eb56c9be45c7a895dd50365cf234', 'request_id': 'req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.857629 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] The token cache is being invalidate because project 609234331bdf4e599bbc73a83b617793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:33.857898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.858538 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.860101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1241/2498] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:33 2022] DELETE /identity/v3/projects/609234331bdf4e599bbc73a83b617793 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:33.862390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:33.864829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:33.866197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:33.866668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6645eb56c9be45c7a895dd50365cf234', 'request_id': 'req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.878930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] The token cache is being invalidate because project 6645eb56c9be45c7a895dd50365cf234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:33.879221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.879883 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-72cc9c3b-c553-4dd9-a286-1d9b36ef7786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:33.881693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1258/2499] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:33 2022] DELETE /identity/v3/projects/6645eb56c9be45c7a895dd50365cf234 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:33.886113 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a540999-8cc3-4ab8-971a-c7c70ae9cb6d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:33.886425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a540999-8cc3-4ab8-971a-c7c70ae9cb6d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:33.886701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a540999-8cc3-4ab8-971a-c7c70ae9cb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:33.904511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6a540999-8cc3-4ab8-971a-c7c70ae9cb6d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:33.905711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6a540999-8cc3-4ab8-971a-c7c70ae9cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:33.931118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994692-4727-4930-914d-f55e384ba572 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:33.975802 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1259/2500] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:33.984351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ec242-0edf-4a61-a4cd-a2bc67de99d1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:33.984532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:33.984690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ec242-0edf-4a61-a4cd-a2bc67de99d1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:33.985135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ec242-0edf-4a61-a4cd-a2bc67de99d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.008174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9b6ec242-0edf-4a61-a4cd-a2bc67de99d1 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:34.008862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.009374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9b6ec242-0edf-4a61-a4cd-a2bc67de99d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:34.009773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.010050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.010347 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] PATH_INFO: `/v3/users/760847b3364842f99dba81f622ff5559` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.011547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=760847b3364842f99dba81f622ff5559)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.013471 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.017495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1260/2501] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:34.021779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ec242-0edf-4a61-a4cd-a2bc67de99d1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.031005 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ec242-0edf-4a61-a4cd-a2bc67de99d1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.036236 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2982f8-2ff5-47b4-b897-3f00d69741dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.036924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2982f8-2ff5-47b4-b897-3f00d69741dd admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.037243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2982f8-2ff5-47b4-b897-3f00d69741dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.037547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2982f8-2ff5-47b4-b897-3f00d69741dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.038401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2982f8-2ff5-47b4-b897-3f00d69741dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:23:34.038742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2982f8-2ff5-47b4-b897-3f00d69741dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.040553 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2982f8-2ff5-47b4-b897-3f00d69741dd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.056789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1261/2502] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:23:34.061162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2982f8-2ff5-47b4-b897-3f00d69741dd admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.072675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760847b3364842f99dba81f622ff5559'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:34.073019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2982f8-2ff5-47b4-b897-3f00d69741dd admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.073333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760847b3364842f99dba81f622ff5559'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:34.077902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f7074-9cc3-45b9-abad-2c5cd37c976a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.078694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f7074-9cc3-45b9-abad-2c5cd37c976a admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.078980 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f7074-9cc3-45b9-abad-2c5cd37c976a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.079255 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f7074-9cc3-45b9-abad-2c5cd37c976a admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.079948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f7074-9cc3-45b9-abad-2c5cd37c976a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.080785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760847b3364842f99dba81f622ff5559'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:34.081945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f7074-9cc3-45b9-abad-2c5cd37c976a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.089469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760847b3364842f99dba81f622ff5559'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:34.103340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760847b3364842f99dba81f622ff5559'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:34.109815 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1242/2503] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:33 2022] DELETE /identity/v3/users/760847b3364842f99dba81f622ff5559 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:34.111346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1262/2504] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:34 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:34.115737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.117239 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:34.184096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c58388-837a-4f5e-b3e1-4d75f5ffcd5d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.243309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77cfd6-24bc-424f-b7cd-2e007cfbd2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.244008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77cfd6-24bc-424f-b7cd-2e007cfbd2ee admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.244291 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77cfd6-24bc-424f-b7cd-2e007cfbd2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.244570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77cfd6-24bc-424f-b7cd-2e007cfbd2ee admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.245276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77cfd6-24bc-424f-b7cd-2e007cfbd2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.247250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77cfd6-24bc-424f-b7cd-2e007cfbd2ee admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.266542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:34.273097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1243/2505] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:34 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:34.276895 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f7074-9cc3-45b9-abad-2c5cd37c976a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.287865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f7074-9cc3-45b9-abad-2c5cd37c976a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.292533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384bc3-5321-4969-a809-8cd71f7373ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.293205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384bc3-5321-4969-a809-8cd71f7373ef admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.293487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384bc3-5321-4969-a809-8cd71f7373ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.293758 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2384bc3-5321-4969-a809-8cd71f7373ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.294516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2384bc3-5321-4969-a809-8cd71f7373ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.296823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2384bc3-5321-4969-a809-8cd71f7373ef admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.307420 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1263/2506] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:34.311245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77cfd6-24bc-424f-b7cd-2e007cfbd2ee admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.321234 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77cfd6-24bc-424f-b7cd-2e007cfbd2ee admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.325961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b123c-67c9-41ba-9daf-02fe7e69e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.326680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b123c-67c9-41ba-9daf-02fe7e69e134 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.326958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b123c-67c9-41ba-9daf-02fe7e69e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.327232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b123c-67c9-41ba-9daf-02fe7e69e134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.327974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b123c-67c9-41ba-9daf-02fe7e69e134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.329546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b123c-67c9-41ba-9daf-02fe7e69e134 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.339994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1244/2507] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:34.344506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384bc3-5321-4969-a809-8cd71f7373ef admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.354990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2384bc3-5321-4969-a809-8cd71f7373ef admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.360063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51984bc2-c7be-418b-b6a0-38d17209a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.361000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51984bc2-c7be-418b-b6a0-38d17209a358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.361294 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51984bc2-c7be-418b-b6a0-38d17209a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.361560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51984bc2-c7be-418b-b6a0-38d17209a358 admin admin] PATH_INFO: `/v3/projects/4daa577635f847b18dd5acae415a5819/users/3c2aaa2773444922a6b5660882d07011/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.380688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51984bc2-c7be-418b-b6a0-38d17209a358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4daa577635f847b18dd5acae415a5819, user_id=3c2aaa2773444922a6b5660882d07011, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.384027 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51984bc2-c7be-418b-b6a0-38d17209a358 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.391995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b123c-67c9-41ba-9daf-02fe7e69e134 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.394836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7b4b123c-67c9-41ba-9daf-02fe7e69e134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:34.400777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1264/2508] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:34 2022] PUT /identity/v3/projects/4daa577635f847b18dd5acae415a5819/users/3c2aaa2773444922a6b5660882d07011/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:34.409424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b123c-67c9-41ba-9daf-02fe7e69e134 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.413106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c8a86-3522-4531-adf3-fb8b1e3efe8b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.413387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c8a86-3522-4531-adf3-fb8b1e3efe8b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.413680 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c8a86-3522-4531-adf3-fb8b1e3efe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.444633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f87c8a86-3522-4531-adf3-fb8b1e3efe8b None None] MFA Rules not processed for user `3c2aaa2773444922a6b5660882d07011`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:34.445871 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f87c8a86-3522-4531-adf3-fb8b1e3efe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:34.473564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.474621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.474904 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.475197 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] PATH_INFO: `/v3/projects/57dfaf1a7bf641c6aca252eba73974b0` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.476383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57dfaf1a7bf641c6aca252eba73974b0)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.478269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.507500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:34.512035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1265/2509] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:34.516112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c8a86-3522-4531-adf3-fb8b1e3efe8b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.526996 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c8a86-3522-4531-adf3-fb8b1e3efe8b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.528392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57dfaf1a7bf641c6aca252eba73974b0', 'request_id': 'req-e6471493-e788-4a0b-896c-3464c2b23931'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:34.535169 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57dfaf1a7bf641c6aca252eba73974b0', 'request_id': 'req-e6471493-e788-4a0b-896c-3464c2b23931'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:34.543843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57dfaf1a7bf641c6aca252eba73974b0', 'request_id': 'req-e6471493-e788-4a0b-896c-3464c2b23931'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:34.555919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] The token cache is being invalidate because project 57dfaf1a7bf641c6aca252eba73974b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:34.556208 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:34.556842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-e6471493-e788-4a0b-896c-3464c2b23931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:34.558514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1245/2510] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:34 2022] DELETE /identity/v3/projects/57dfaf1a7bf641c6aca252eba73974b0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:34.563102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02275d4a-dccb-4de2-99c0-0d71503a4968 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.563381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02275d4a-dccb-4de2-99c0-0d71503a4968 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.563647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02275d4a-dccb-4de2-99c0-0d71503a4968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.583287 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-02275d4a-dccb-4de2-99c0-0d71503a4968 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:34.584503 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-02275d4a-dccb-4de2-99c0-0d71503a4968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:34.587213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19312675-a288-4871-aee7-726ef87d669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.587925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19312675-a288-4871-aee7-726ef87d669e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.588257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19312675-a288-4871-aee7-726ef87d669e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.588537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19312675-a288-4871-aee7-726ef87d669e admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.589264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19312675-a288-4871-aee7-726ef87d669e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.591225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19312675-a288-4871-aee7-726ef87d669e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.592859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1246/2511] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:34.600877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a8949-0b02-4401-a7c6-d92e218a9a75 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.601161 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a8949-0b02-4401-a7c6-d92e218a9a75 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.601433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a8949-0b02-4401-a7c6-d92e218a9a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.619578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-3f1a8949-0b02-4401-a7c6-d92e218a9a75 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:34.620768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3f1a8949-0b02-4401-a7c6-d92e218a9a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:34.622962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1266/2512] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:34 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:34.623692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19312675-a288-4871-aee7-726ef87d669e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.625287 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-19312675-a288-4871-aee7-726ef87d669e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:34.680376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1247/2513] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:34.684787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a8949-0b02-4401-a7c6-d92e218a9a75 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.689993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19312675-a288-4871-aee7-726ef87d669e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.695513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883b2aa-1f0b-49dc-8528-fbd4e4147854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.696190 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b2aa-1f0b-49dc-8528-fbd4e4147854 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.696469 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b2aa-1f0b-49dc-8528-fbd4e4147854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.696740 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b2aa-1f0b-49dc-8528-fbd4e4147854 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.697429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883b2aa-1f0b-49dc-8528-fbd4e4147854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.697540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a8949-0b02-4401-a7c6-d92e218a9a75 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.699440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883b2aa-1f0b-49dc-8528-fbd4e4147854 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.702229 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fab99-9cf0-4f3a-972e-78b64da40cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.702932 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fab99-9cf0-4f3a-972e-78b64da40cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.703291 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fab99-9cf0-4f3a-972e-78b64da40cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.703593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fab99-9cf0-4f3a-972e-78b64da40cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.704376 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fab99-9cf0-4f3a-972e-78b64da40cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:23:34.704681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fab99-9cf0-4f3a-972e-78b64da40cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.706657 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fab99-9cf0-4f3a-972e-78b64da40cf0 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.718878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:34.726643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1267/2514] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:34 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:34.726857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1248/2515] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:23:34.727784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fab99-9cf0-4f3a-972e-78b64da40cf0 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.728009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883b2aa-1f0b-49dc-8528-fbd4e4147854 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.739081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fab99-9cf0-4f3a-972e-78b64da40cf0 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.741476 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883b2aa-1f0b-49dc-8528-fbd4e4147854 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.744387 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a7e5e-5b49-4fab-99e6-fa3099127038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.745023 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a7e5e-5b49-4fab-99e6-fa3099127038 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.745304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a7e5e-5b49-4fab-99e6-fa3099127038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.745532 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6f84-ba32-431b-99f4-c1002c6b36da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.745656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a7e5e-5b49-4fab-99e6-fa3099127038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.746194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6f84-ba32-431b-99f4-c1002c6b36da admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.746337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a7e5e-5b49-4fab-99e6-fa3099127038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.746513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6f84-ba32-431b-99f4-c1002c6b36da admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.746784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6f84-ba32-431b-99f4-c1002c6b36da admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.747637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b6f84-ba32-431b-99f4-c1002c6b36da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.748229 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a7e5e-5b49-4fab-99e6-fa3099127038 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.749230 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b6f84-ba32-431b-99f4-c1002c6b36da admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.760962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1268/2516] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:34.764990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6f84-ba32-431b-99f4-c1002c6b36da admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.775914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6f84-ba32-431b-99f4-c1002c6b36da admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.780868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56be2e0-e7d0-41fa-8f9b-a1370202a2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.781872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56be2e0-e7d0-41fa-8f9b-a1370202a2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.782161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56be2e0-e7d0-41fa-8f9b-a1370202a2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.782472 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56be2e0-e7d0-41fa-8f9b-a1370202a2b7 admin admin] PATH_INFO: `/v3/projects/6d2fe5b6e9f747d28ae9d544e6fbf51d/users/1e2cc732e7f040f0aac8faa8ed50b5b7/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.784184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1249/2517] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:34 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:34.788675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a7e5e-5b49-4fab-99e6-fa3099127038 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.800836 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56be2e0-e7d0-41fa-8f9b-a1370202a2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2fe5b6e9f747d28ae9d544e6fbf51d, user_id=1e2cc732e7f040f0aac8faa8ed50b5b7, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.803712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56be2e0-e7d0-41fa-8f9b-a1370202a2b7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.824478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1269/2518] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:34 2022] PUT /identity/v3/projects/6d2fe5b6e9f747d28ae9d544e6fbf51d/users/1e2cc732e7f040f0aac8faa8ed50b5b7/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:34.830707 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56be2e0-e7d0-41fa-8f9b-a1370202a2b7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.872250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a7e5e-5b49-4fab-99e6-fa3099127038 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.892127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:34.912880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56be2e0-e7d0-41fa-8f9b-a1370202a2b7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.917773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d836ba-2763-4cb1-b833-1d37b539273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.918614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d836ba-2763-4cb1-b833-1d37b539273e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.918896 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d836ba-2763-4cb1-b833-1d37b539273e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.919174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d836ba-2763-4cb1-b833-1d37b539273e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.919906 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d836ba-2763-4cb1-b833-1d37b539273e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.921516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d836ba-2763-4cb1-b833-1d37b539273e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.931516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1270/2519] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:23:34.935793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d836ba-2763-4cb1-b833-1d37b539273e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.936915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800166c-075d-43ca-8cf9-b82011d867a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.937628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800166c-075d-43ca-8cf9-b82011d867a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.937909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800166c-075d-43ca-8cf9-b82011d867a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.938184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800166c-075d-43ca-8cf9-b82011d867a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.938909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800166c-075d-43ca-8cf9-b82011d867a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.940835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800166c-075d-43ca-8cf9-b82011d867a5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.945845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d836ba-2763-4cb1-b833-1d37b539273e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.951351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35183c0-3ccd-48c1-8b37-af5b04b00202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:34.952301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35183c0-3ccd-48c1-8b37-af5b04b00202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.952627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35183c0-3ccd-48c1-8b37-af5b04b00202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.952927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35183c0-3ccd-48c1-8b37-af5b04b00202 admin admin] PATH_INFO: `/v3/projects/6d2fe5b6e9f747d28ae9d544e6fbf51d/users/1e2cc732e7f040f0aac8faa8ed50b5b7/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:34.955229 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35183c0-3ccd-48c1-8b37-af5b04b00202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2fe5b6e9f747d28ae9d544e6fbf51d, user_id=1e2cc732e7f040f0aac8faa8ed50b5b7, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:34.958781 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35183c0-3ccd-48c1-8b37-af5b04b00202 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:34.961871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1250/2520] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:34 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:34.965999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800166c-075d-43ca-8cf9-b82011d867a5 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:34.970665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1271/2521] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:34 2022] PUT /identity/v3/projects/6d2fe5b6e9f747d28ae9d544e6fbf51d/users/1e2cc732e7f040f0aac8faa8ed50b5b7/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:34.981209 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e306-e301-4ad1-96c7-bdc744f5ada3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:34.981485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e306-e301-4ad1-96c7-bdc744f5ada3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:34.981764 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800166c-075d-43ca-8cf9-b82011d867a5 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:34.981874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e306-e301-4ad1-96c7-bdc744f5ada3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.010095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2b24e306-e301-4ad1-96c7-bdc744f5ada3 None None] MFA Rules not processed for user `1e2cc732e7f040f0aac8faa8ed50b5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:35.011450 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2b24e306-e301-4ad1-96c7-bdc744f5ada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:35.050040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bc590-f98e-4456-b91b-2b5916fafaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.050989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bc590-f98e-4456-b91b-2b5916fafaaa admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.051561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bc590-f98e-4456-b91b-2b5916fafaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.051561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bc590-f98e-4456-b91b-2b5916fafaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.052253 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bc590-f98e-4456-b91b-2b5916fafaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.053845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bc590-f98e-4456-b91b-2b5916fafaaa admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.067338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1251/2522] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:23:35.071248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bc590-f98e-4456-b91b-2b5916fafaaa admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:35.080805 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bc590-f98e-4456-b91b-2b5916fafaaa admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:35.085381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8785d-e4f8-48b8-8328-953077828da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.086028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8785d-e4f8-48b8-8328-953077828da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.086332 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8785d-e4f8-48b8-8328-953077828da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.086605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8785d-e4f8-48b8-8328-953077828da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.087323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8785d-e4f8-48b8-8328-953077828da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.088919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8785d-e4f8-48b8-8328-953077828da4 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.096206 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1272/2523] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:35.099211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:35.106600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1252/2524] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:35.109410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24e306-e301-4ad1-96c7-bdc744f5ada3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:35.109938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8785d-e4f8-48b8-8328-953077828da4 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:35.110976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2b24e306-e301-4ad1-96c7-bdc744f5ada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:35.120920 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8785d-e4f8-48b8-8328-953077828da4 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:35.125969 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81724cc4-2076-4d21-a3dc-cf012616f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.126893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81724cc4-2076-4d21-a3dc-cf012616f07d admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.127164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81724cc4-2076-4d21-a3dc-cf012616f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.127573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81724cc4-2076-4d21-a3dc-cf012616f07d admin admin] PATH_INFO: `/v3/projects/3f67f537e273473094b8b5497a17b629/users/02bd620fd25244449095d2f75896416f/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.142578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81724cc4-2076-4d21-a3dc-cf012616f07d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f67f537e273473094b8b5497a17b629, user_id=02bd620fd25244449095d2f75896416f, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.145348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81724cc4-2076-4d21-a3dc-cf012616f07d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.161133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1253/2525] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:35 2022] PUT /identity/v3/projects/3f67f537e273473094b8b5497a17b629/users/02bd620fd25244449095d2f75896416f/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:35.170204 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24e306-e301-4ad1-96c7-bdc744f5ada3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:35.172475 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366a403-e23a-4890-b2f8-52f599b9a661 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.172764 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366a403-e23a-4890-b2f8-52f599b9a661 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.173037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366a403-e23a-4890-b2f8-52f599b9a661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.200105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-4366a403-e23a-4890-b2f8-52f599b9a661 None None] MFA Rules not processed for user `02bd620fd25244449095d2f75896416f`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:35.201273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-4366a403-e23a-4890-b2f8-52f599b9a661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:35.221941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578cb1-1200-4dda-b589-3b3a6c58eefc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.222735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578cb1-1200-4dda-b589-3b3a6c58eefc service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.222977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578cb1-1200-4dda-b589-3b3a6c58eefc service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.223387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578cb1-1200-4dda-b589-3b3a6c58eefc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.240736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:35.267218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1254/2526] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:35.271855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366a403-e23a-4890-b2f8-52f599b9a661 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:35.287750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4578cb1-1200-4dda-b589-3b3a6c58eefc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.289205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4578cb1-1200-4dda-b589-3b3a6c58eefc service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.302036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1273/2527] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:35.338701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366a403-e23a-4890-b2f8-52f599b9a661 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:35.343825 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c767074-4618-49a7-8aa9-4b88100b4ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.344574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767074-4618-49a7-8aa9-4b88100b4ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.344884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767074-4618-49a7-8aa9-4b88100b4ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.345159 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767074-4618-49a7-8aa9-4b88100b4ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.345299 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578cb1-1200-4dda-b589-3b3a6c58eefc service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:35.345863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c767074-4618-49a7-8aa9-4b88100b4ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.346743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a4578cb1-1200-4dda-b589-3b3a6c58eefc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:35.348230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c767074-4618-49a7-8aa9-4b88100b4ab7 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.357836 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578cb1-1200-4dda-b589-3b3a6c58eefc service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:35.361501 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460ed73-6ade-47a5-8738-f942bebced03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.362164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ed73-6ade-47a5-8738-f942bebced03 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.362492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ed73-6ade-47a5-8738-f942bebced03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.362768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ed73-6ade-47a5-8738-f942bebced03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.365284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e460ed73-6ade-47a5-8738-f942bebced03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:35.375460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1255/2528] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:35 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:35.380038 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c767074-4618-49a7-8aa9-4b88100b4ab7 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:35.429392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460ed73-6ade-47a5-8738-f942bebced03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.430939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:35.431107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460ed73-6ade-47a5-8738-f942bebced03 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.440652 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1274/2529] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:23:35.444411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c767074-4618-49a7-8aa9-4b88100b4ab7 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:35.448996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e6fdf-218b-4df7-98d3-83345b4ddb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.449665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e6fdf-218b-4df7-98d3-83345b4ddb6d admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.449944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e6fdf-218b-4df7-98d3-83345b4ddb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.450269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e6fdf-218b-4df7-98d3-83345b4ddb6d admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.450935 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e6fdf-218b-4df7-98d3-83345b4ddb6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.452899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e6fdf-218b-4df7-98d3-83345b4ddb6d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.476620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1256/2530] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:35 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:35.479008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460ed73-6ade-47a5-8738-f942bebced03 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:35.491480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460ed73-6ade-47a5-8738-f942bebced03 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:35.496079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291cbc-5180-412c-887d-0d84b520eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.496785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291cbc-5180-412c-887d-0d84b520eb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.497013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291cbc-5180-412c-887d-0d84b520eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.497281 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291cbc-5180-412c-887d-0d84b520eb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.497994 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca291cbc-5180-412c-887d-0d84b520eb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.499611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca291cbc-5180-412c-887d-0d84b520eb6a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.510263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1275/2531] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:23:35.514509 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e6fdf-218b-4df7-98d3-83345b4ddb6d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:35.525400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e6fdf-218b-4df7-98d3-83345b4ddb6d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:35.530616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8069f3-e079-4e73-8cc4-cd62d5661f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.531539 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8069f3-e079-4e73-8cc4-cd62d5661f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.531811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8069f3-e079-4e73-8cc4-cd62d5661f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.532084 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8069f3-e079-4e73-8cc4-cd62d5661f12 admin admin] PATH_INFO: `/v3/projects/9bc29e98b4c547859355bc6be25cf78f/users/e2d53d36b422468c9438edcde4b11ccb/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.549269 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8069f3-e079-4e73-8cc4-cd62d5661f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc29e98b4c547859355bc6be25cf78f, user_id=e2d53d36b422468c9438edcde4b11ccb, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.552155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8069f3-e079-4e73-8cc4-cd62d5661f12 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.567170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1257/2532] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:35 2022] PUT /identity/v3/projects/9bc29e98b4c547859355bc6be25cf78f/users/e2d53d36b422468c9438edcde4b11ccb/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:35.571843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291cbc-5180-412c-887d-0d84b520eb6a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:35.582733 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291cbc-5180-412c-887d-0d84b520eb6a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:35.644122 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63f14b-56c5-4d8d-90bc-a2d22a339ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.645171 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63f14b-56c5-4d8d-90bc-a2d22a339ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.645461 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63f14b-56c5-4d8d-90bc-a2d22a339ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.645734 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63f14b-56c5-4d8d-90bc-a2d22a339ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.646524 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63f14b-56c5-4d8d-90bc-a2d22a339ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.648338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63f14b-56c5-4d8d-90bc-a2d22a339ee7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.658935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1276/2533] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:35.663593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8069f3-e079-4e73-8cc4-cd62d5661f12 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:35.682547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8069f3-e079-4e73-8cc4-cd62d5661f12 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:35.682547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14222b10-baaf-4faf-b32c-516c36520131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.682547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14222b10-baaf-4faf-b32c-516c36520131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.682547 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14222b10-baaf-4faf-b32c-516c36520131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.683341 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14222b10-baaf-4faf-b32c-516c36520131 admin admin] PATH_INFO: `/v3/projects/9bc29e98b4c547859355bc6be25cf78f/users/e2d53d36b422468c9438edcde4b11ccb/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.684995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14222b10-baaf-4faf-b32c-516c36520131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc29e98b4c547859355bc6be25cf78f, user_id=e2d53d36b422468c9438edcde4b11ccb, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.687890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14222b10-baaf-4faf-b32c-516c36520131 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.700093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1258/2534] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:35 2022] PUT /identity/v3/projects/9bc29e98b4c547859355bc6be25cf78f/users/e2d53d36b422468c9438edcde4b11ccb/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:35.711257 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa4528-6d90-4701-80b2-444fc9a1e8ba None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.711542 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa4528-6d90-4701-80b2-444fc9a1e8ba None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.712064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa4528-6d90-4701-80b2-444fc9a1e8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.746440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2afa4528-6d90-4701-80b2-444fc9a1e8ba None None] MFA Rules not processed for user `e2d53d36b422468c9438edcde4b11ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:35.747712 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2afa4528-6d90-4701-80b2-444fc9a1e8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:35.789390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:35.835433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1277/2535] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:35.847883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14222b10-baaf-4faf-b32c-516c36520131 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:35.903784 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14222b10-baaf-4faf-b32c-516c36520131 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:35.908047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada5183-6ffb-4ba3-a5cf-1bb81f5fd8f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:35.908748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada5183-6ffb-4ba3-a5cf-1bb81f5fd8f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:35.909129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada5183-6ffb-4ba3-a5cf-1bb81f5fd8f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:35.909392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada5183-6ffb-4ba3-a5cf-1bb81f5fd8f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:35.920426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada5183-6ffb-4ba3-a5cf-1bb81f5fd8f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:35.921994 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada5183-6ffb-4ba3-a5cf-1bb81f5fd8f5 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:35.932350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1259/2536] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:35.960443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa4528-6d90-4701-80b2-444fc9a1e8ba None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:36.023022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa4528-6d90-4701-80b2-444fc9a1e8ba None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:36.027674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:36.028560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:36.028837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:36.029111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] PATH_INFO: `/v3/users/02bd620fd25244449095d2f75896416f` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:36.030326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] RBAC: Authorizing `identity:delete_user(user_id=02bd620fd25244449095d2f75896416f)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:36.032254 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:36.096154 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02bd620fd25244449095d2f75896416f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.096823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02bd620fd25244449095d2f75896416f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.111074 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02bd620fd25244449095d2f75896416f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.128615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02bd620fd25244449095d2f75896416f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.135753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02bd620fd25244449095d2f75896416f'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.142701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1278/2537] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:35 2022] DELETE /identity/v3/users/02bd620fd25244449095d2f75896416f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:36.146899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bae08a-c6d2-4268-a138-d4551fb5914a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:36.147187 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bae08a-c6d2-4268-a138-d4551fb5914a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:36.147461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bae08a-c6d2-4268-a138-d4551fb5914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:36.165390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-99bae08a-c6d2-4268-a138-d4551fb5914a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:36.166678 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-99bae08a-c6d2-4268-a138-d4551fb5914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:36.226386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1260/2538] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:36.236621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:36.238237 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:36.286622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:36.300081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44493b3d-7356-47cd-be58-6fed5e0a147f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:36.304279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f589f-d19c-4614-bd31-d12faa86046e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:36.305160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f589f-d19c-4614-bd31-d12faa86046e service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:36.305447 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f589f-d19c-4614-bd31-d12faa86046e service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:36.305727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f589f-d19c-4614-bd31-d12faa86046e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:36.317296 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f589f-d19c-4614-bd31-d12faa86046e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:36.318787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f589f-d19c-4614-bd31-d12faa86046e service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:36.328974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1279/2539] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:36.612893 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bae08a-c6d2-4268-a138-d4551fb5914a None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:36.614910 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-99bae08a-c6d2-4268-a138-d4551fb5914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:36.628822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bae08a-c6d2-4268-a138-d4551fb5914a None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:36.634252 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:36.635165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:36.635438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:36.635705 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] PATH_INFO: `/v3/projects/3f67f537e273473094b8b5497a17b629` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:36.637606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f67f537e273473094b8b5497a17b629)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:36.639572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:36.683460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:36.690939 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f67f537e273473094b8b5497a17b629', 'request_id': 'req-39b7a50a-0f2d-4340-8c14-049df44886bc'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.697929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f67f537e273473094b8b5497a17b629', 'request_id': 'req-39b7a50a-0f2d-4340-8c14-049df44886bc'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.706663 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f67f537e273473094b8b5497a17b629', 'request_id': 'req-39b7a50a-0f2d-4340-8c14-049df44886bc'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.717833 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] The token cache is being invalidate because project 3f67f537e273473094b8b5497a17b629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:36.718128 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.718782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.720578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1261/2540] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:36 2022] DELETE /identity/v3/projects/3f67f537e273473094b8b5497a17b629 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:36.725958 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f589f-d19c-4614-bd31-d12faa86046e service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:36.740425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f589f-d19c-4614-bd31-d12faa86046e service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:36.803574 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f992a-9e9c-42ce-821a-7ff247184791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:36.804487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f992a-9e9c-42ce-821a-7ff247184791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:36.804748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f992a-9e9c-42ce-821a-7ff247184791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:36.805020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f992a-9e9c-42ce-821a-7ff247184791 admin admin] PATH_INFO: `/v3/users/e2d53d36b422468c9438edcde4b11ccb` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:36.806205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f992a-9e9c-42ce-821a-7ff247184791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d53d36b422468c9438edcde4b11ccb)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:36.808161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f992a-9e9c-42ce-821a-7ff247184791 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:36.867459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-652f992a-9e9c-42ce-821a-7ff247184791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d53d36b422468c9438edcde4b11ccb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.868135 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-652f992a-9e9c-42ce-821a-7ff247184791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d53d36b422468c9438edcde4b11ccb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.877918 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-652f992a-9e9c-42ce-821a-7ff247184791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d53d36b422468c9438edcde4b11ccb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.893697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-652f992a-9e9c-42ce-821a-7ff247184791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d53d36b422468c9438edcde4b11ccb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.901205 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-652f992a-9e9c-42ce-821a-7ff247184791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d53d36b422468c9438edcde4b11ccb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:36.908268 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1280/2541] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:36 2022] DELETE /identity/v3/users/e2d53d36b422468c9438edcde4b11ccb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:37.299530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:37.302063 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:37.316032 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7a50a-0f2d-4340-8c14-049df44886bc admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:37.383512 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:37.384392 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:37.384672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:37.384944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] PATH_INFO: `/v3/projects/9bc29e98b4c547859355bc6be25cf78f` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:37.386114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc29e98b4c547859355bc6be25cf78f)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:37.388052 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:37.439307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc29e98b4c547859355bc6be25cf78f', 'request_id': 'req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:37.445936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc29e98b4c547859355bc6be25cf78f', 'request_id': 'req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:37.456644 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc29e98b4c547859355bc6be25cf78f', 'request_id': 'req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:37.468933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] The token cache is being invalidate because project 9bc29e98b4c547859355bc6be25cf78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:37.469238 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:37.469952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9f2a55bc-bf4f-4f03-b632-5f1454f3c5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:37.471582 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1262/2542] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:37 2022] DELETE /identity/v3/projects/9bc29e98b4c547859355bc6be25cf78f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:37.476798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2cca-9385-4bfa-9b77-0cca543dfc1a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:37.477084 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2cca-9385-4bfa-9b77-0cca543dfc1a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:37.477359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2cca-9385-4bfa-9b77-0cca543dfc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:37.497777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a74d2cca-9385-4bfa-9b77-0cca543dfc1a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:37.499009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a74d2cca-9385-4bfa-9b77-0cca543dfc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:37.562263 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1281/2543] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:37.570404 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83305ed6-fa80-4869-ba58-d18b0f9f6dbf None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:37.570691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83305ed6-fa80-4869-ba58-d18b0f9f6dbf None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:37.570962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83305ed6-fa80-4869-ba58-d18b0f9f6dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:37.590558 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-83305ed6-fa80-4869-ba58-d18b0f9f6dbf None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:37.592117 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-83305ed6-fa80-4869-ba58-d18b0f9f6dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:37.601192 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1263/2544] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:37.605494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d2cca-9385-4bfa-9b77-0cca543dfc1a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:37.611532 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:37.616066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d2cca-9385-4bfa-9b77-0cca543dfc1a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:37.621893 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df90922-91c1-4b50-bee2-908a79cf828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:37.622615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df90922-91c1-4b50-bee2-908a79cf828e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:37.622918 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df90922-91c1-4b50-bee2-908a79cf828e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:37.623244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df90922-91c1-4b50-bee2-908a79cf828e admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:37.624477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df90922-91c1-4b50-bee2-908a79cf828e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:23:37.625081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df90922-91c1-4b50-bee2-908a79cf828e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:37.627202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df90922-91c1-4b50-bee2-908a79cf828e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:37.639975 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1282/2545] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:23:37.644498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83305ed6-fa80-4869-ba58-d18b0f9f6dbf None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:37.654403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83305ed6-fa80-4869-ba58-d18b0f9f6dbf None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:37.659626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a8e8b-a4b5-499a-992c-beddd7aaa41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:37.660468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8e8b-a4b5-499a-992c-beddd7aaa41b admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:37.660468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8e8b-a4b5-499a-992c-beddd7aaa41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:37.661005 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8e8b-a4b5-499a-992c-beddd7aaa41b admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:37.661679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a8e8b-a4b5-499a-992c-beddd7aaa41b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:37.663633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a8e8b-a4b5-499a-992c-beddd7aaa41b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:37.700603 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1264/2546] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:37 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:37.701776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df90922-91c1-4b50-bee2-908a79cf828e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:37.713859 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df90922-91c1-4b50-bee2-908a79cf828e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:37.780324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87ff4e-32d4-4b3c-b023-2bf665bf9657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:37.781080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87ff4e-32d4-4b3c-b023-2bf665bf9657 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:37.781363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87ff4e-32d4-4b3c-b023-2bf665bf9657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:37.781635 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87ff4e-32d4-4b3c-b023-2bf665bf9657 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:37.782379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87ff4e-32d4-4b3c-b023-2bf665bf9657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:37.784696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87ff4e-32d4-4b3c-b023-2bf665bf9657 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:37.807223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1283/2547] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:37 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:37.811895 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a8e8b-a4b5-499a-992c-beddd7aaa41b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:37.830486 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a8e8b-a4b5-499a-992c-beddd7aaa41b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:37.837105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6e1df-859e-4e01-a649-6fb9ba163171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:37.837950 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e1df-859e-4e01-a649-6fb9ba163171 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:37.838350 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e1df-859e-4e01-a649-6fb9ba163171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:37.838709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e1df-859e-4e01-a649-6fb9ba163171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:37.839601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6e1df-859e-4e01-a649-6fb9ba163171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:37.841782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6e1df-859e-4e01-a649-6fb9ba163171 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:37.854886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1265/2548] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:37.859500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87ff4e-32d4-4b3c-b023-2bf665bf9657 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:37.870823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87ff4e-32d4-4b3c-b023-2bf665bf9657 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:37.875533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7762841-a159-461c-b63f-fb80f30206c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:37.876226 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7762841-a159-461c-b63f-fb80f30206c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:37.876495 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7762841-a159-461c-b63f-fb80f30206c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:37.876772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7762841-a159-461c-b63f-fb80f30206c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:37.877504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7762841-a159-461c-b63f-fb80f30206c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:37.879513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7762841-a159-461c-b63f-fb80f30206c6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:37.891832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1284/2549] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:37.896224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6e1df-859e-4e01-a649-6fb9ba163171 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:37.906283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6e1df-859e-4e01-a649-6fb9ba163171 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:37.911439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff488e2c-db8f-43b2-8100-999b383a762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:37.912367 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff488e2c-db8f-43b2-8100-999b383a762e admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:37.912623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff488e2c-db8f-43b2-8100-999b383a762e admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:37.912912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff488e2c-db8f-43b2-8100-999b383a762e admin admin] PATH_INFO: `/v3/projects/26228e518e9149aba3967d1441918b39/users/36fe58f8d4e248d1877ef64515d02a7b/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:37.928675 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff488e2c-db8f-43b2-8100-999b383a762e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26228e518e9149aba3967d1441918b39, user_id=36fe58f8d4e248d1877ef64515d02a7b, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:37.931617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff488e2c-db8f-43b2-8100-999b383a762e admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:37.934894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:37.948900 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1266/2550] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:37 2022] PUT /identity/v3/projects/26228e518e9149aba3967d1441918b39/users/36fe58f8d4e248d1877ef64515d02a7b/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:37.960511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1fed6-55b3-4b79-9e1a-7c58f84e844a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:37.960795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1fed6-55b3-4b79-9e1a-7c58f84e844a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:37.961066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1fed6-55b3-4b79-9e1a-7c58f84e844a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:37.991178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7fc1fed6-55b3-4b79-9e1a-7c58f84e844a None None] MFA Rules not processed for user `36fe58f8d4e248d1877ef64515d02a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:37.992419 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7fc1fed6-55b3-4b79-9e1a-7c58f84e844a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:38.061956 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1285/2551] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:38.066450 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff488e2c-db8f-43b2-8100-999b383a762e admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:38.134325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff488e2c-db8f-43b2-8100-999b383a762e admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:38.139781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad515c1-7182-44ff-8e16-ecec76963f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:38.140457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad515c1-7182-44ff-8e16-ecec76963f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:38.140733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad515c1-7182-44ff-8e16-ecec76963f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:38.141003 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad515c1-7182-44ff-8e16-ecec76963f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:38.141695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad515c1-7182-44ff-8e16-ecec76963f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:38.143660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad515c1-7182-44ff-8e16-ecec76963f68 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:38.171386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1267/2552] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:38 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:38.175653 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1fed6-55b3-4b79-9e1a-7c58f84e844a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:38.186315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1fed6-55b3-4b79-9e1a-7c58f84e844a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:38.243021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b93227-3525-41d3-b4b1-f24b3fed52ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:38.243728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b93227-3525-41d3-b4b1-f24b3fed52ea admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:38.243996 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b93227-3525-41d3-b4b1-f24b3fed52ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:38.244274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b93227-3525-41d3-b4b1-f24b3fed52ea admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:38.244974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b93227-3525-41d3-b4b1-f24b3fed52ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:38.246932 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b93227-3525-41d3-b4b1-f24b3fed52ea admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:38.253684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:38.271731 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1286/2553] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:38 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:38.275791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad515c1-7182-44ff-8e16-ecec76963f68 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:38.287758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad515c1-7182-44ff-8e16-ecec76963f68 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:38.294000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad1caa-14e5-4971-a1f4-0a76fa3249fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:38.299866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad1caa-14e5-4971-a1f4-0a76fa3249fd admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:38.299866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad1caa-14e5-4971-a1f4-0a76fa3249fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:38.299866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad1caa-14e5-4971-a1f4-0a76fa3249fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:38.299866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad1caa-14e5-4971-a1f4-0a76fa3249fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:38.299866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad1caa-14e5-4971-a1f4-0a76fa3249fd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:38.313075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1268/2554] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:38.314322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b93227-3525-41d3-b4b1-f24b3fed52ea admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:38.325158 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b93227-3525-41d3-b4b1-f24b3fed52ea admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:38.330614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73d31f-aa91-4f16-9aea-4863e8ff6137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:38.331300 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73d31f-aa91-4f16-9aea-4863e8ff6137 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:38.331580 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73d31f-aa91-4f16-9aea-4863e8ff6137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:38.331954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73d31f-aa91-4f16-9aea-4863e8ff6137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:38.332693 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73d31f-aa91-4f16-9aea-4863e8ff6137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:38.334321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73d31f-aa91-4f16-9aea-4863e8ff6137 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:38.352507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1287/2555] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:38.353913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad1caa-14e5-4971-a1f4-0a76fa3249fd admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:38.380528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad1caa-14e5-4971-a1f4-0a76fa3249fd admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:38.397882 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b73c70-0daf-40fd-a107-0a5e04f9634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:38.399453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b73c70-0daf-40fd-a107-0a5e04f9634d admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:38.400064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b73c70-0daf-40fd-a107-0a5e04f9634d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:38.400821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b73c70-0daf-40fd-a107-0a5e04f9634d admin admin] PATH_INFO: `/v3/projects/22fc3ca4eeb24e7cb757f7f23849e9c1/users/742f98dfafb94cf386ac70b6439f77fd/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:38.420526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b73c70-0daf-40fd-a107-0a5e04f9634d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fc3ca4eeb24e7cb757f7f23849e9c1, user_id=742f98dfafb94cf386ac70b6439f77fd, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:38.423546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b73c70-0daf-40fd-a107-0a5e04f9634d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:38.450861 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1269/2556] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:38 2022] PUT /identity/v3/projects/22fc3ca4eeb24e7cb757f7f23849e9c1/users/742f98dfafb94cf386ac70b6439f77fd/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:38.452942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f451e9-e6eb-4800-9575-33026b11f056 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:38.452942 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f451e9-e6eb-4800-9575-33026b11f056 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:38.453373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f451e9-e6eb-4800-9575-33026b11f056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:38.486514 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b3f451e9-e6eb-4800-9575-33026b11f056 None None] MFA Rules not processed for user `742f98dfafb94cf386ac70b6439f77fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:38.487765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b3f451e9-e6eb-4800-9575-33026b11f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:38.618194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1288/2557] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:38.622655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b73c70-0daf-40fd-a107-0a5e04f9634d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:38.740335 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b73c70-0daf-40fd-a107-0a5e04f9634d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:38.749717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a9e14-dedc-4f24-a1d1-350056576171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:38.750847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a9e14-dedc-4f24-a1d1-350056576171 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:38.751134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a9e14-dedc-4f24-a1d1-350056576171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:38.751409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a9e14-dedc-4f24-a1d1-350056576171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:38.752414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a9e14-dedc-4f24-a1d1-350056576171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:38.754723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a9e14-dedc-4f24-a1d1-350056576171 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:38.767985 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62783d00-46c0-4598-840f-7aa8024d244c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:38.768736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62783d00-46c0-4598-840f-7aa8024d244c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:38.768902 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62783d00-46c0-4598-840f-7aa8024d244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:38.792462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-62783d00-46c0-4598-840f-7aa8024d244c None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:38.793916 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-62783d00-46c0-4598-840f-7aa8024d244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:38.801337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1270/2558] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:38 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:38.806325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a9e14-dedc-4f24-a1d1-350056576171 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:38.855641 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:38.872106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1289/2559] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:23:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:38.890138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62783d00-46c0-4598-840f-7aa8024d244c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:38.891714 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-62783d00-46c0-4598-840f-7aa8024d244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:38.908157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a9e14-dedc-4f24-a1d1-350056576171 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:38.913603 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f66f2d-2a3e-433e-b1bd-9e3fda2d298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:38.914327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f66f2d-2a3e-433e-b1bd-9e3fda2d298d admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:38.914616 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f66f2d-2a3e-433e-b1bd-9e3fda2d298d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:38.914889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f66f2d-2a3e-433e-b1bd-9e3fda2d298d admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:38.915596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f66f2d-2a3e-433e-b1bd-9e3fda2d298d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:38.917525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f66f2d-2a3e-433e-b1bd-9e3fda2d298d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:38.944977 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1271/2560] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:38 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:38.946064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f66f2d-2a3e-433e-b1bd-9e3fda2d298d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:38.948282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-06f66f2d-2a3e-433e-b1bd-9e3fda2d298d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:38.963361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f66f2d-2a3e-433e-b1bd-9e3fda2d298d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:38.969134 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:38.970064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:38.970340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:38.970625 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] PATH_INFO: `/v3/users/3c2aaa2773444922a6b5660882d07011` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:38.971925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2aaa2773444922a6b5660882d07011)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:38.973898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:38.993055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62783d00-46c0-4598-840f-7aa8024d244c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:39.007534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:39.026232 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2aaa2773444922a6b5660882d07011'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:39.026990 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2aaa2773444922a6b5660882d07011'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:39.034695 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2aaa2773444922a6b5660882d07011'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:39.044453 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2aaa2773444922a6b5660882d07011'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:39.063485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2aaa2773444922a6b5660882d07011'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:39.065326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d0212-6762-4bd4-9715-9154b82f8ebc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:39.066159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d0212-6762-4bd4-9715-9154b82f8ebc service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.067026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d0212-6762-4bd4-9715-9154b82f8ebc service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.067299 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d0212-6762-4bd4-9715-9154b82f8ebc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.069276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-553d0212-6762-4bd4-9715-9154b82f8ebc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:39.071182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1272/2561] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:38 2022] DELETE /identity/v3/users/3c2aaa2773444922a6b5660882d07011 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:39.071835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:39.073340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:39.133024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d0212-6762-4bd4-9715-9154b82f8ebc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:39.134700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d0212-6762-4bd4-9715-9154b82f8ebc service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:39.143369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1290/2562] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:23:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:23:39.144623 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61b2a9-2181-4290-8c5d-7a0ef898fb7b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:39.144832 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818722a3-91e8-42c0-9459-6597566da73c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.145123 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818722a3-91e8-42c0-9459-6597566da73c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.145409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818722a3-91e8-42c0-9459-6597566da73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.150040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8f021-c78c-4841-bc7c-a3c36336fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:39.150750 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8f021-c78c-4841-bc7c-a3c36336fae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.151160 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8f021-c78c-4841-bc7c-a3c36336fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.151328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8f021-c78c-4841-bc7c-a3c36336fae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.152061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8f021-c78c-4841-bc7c-a3c36336fae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:39.153668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8f021-c78c-4841-bc7c-a3c36336fae4 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:39.164273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-818722a3-91e8-42c0-9459-6597566da73c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:39.164978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1273/2563] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:39.165838 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-818722a3-91e8-42c0-9459-6597566da73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:39.169601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8f021-c78c-4841-bc7c-a3c36336fae4 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:39.174852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1291/2564] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:39.185076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818722a3-91e8-42c0-9459-6597566da73c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:39.186788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-818722a3-91e8-42c0-9459-6597566da73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:39.196777 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8f021-c78c-4841-bc7c-a3c36336fae4 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:39.202619 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7af778-1c9a-4148-9564-ab358ce510a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:39.203326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7af778-1c9a-4148-9564-ab358ce510a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.203620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7af778-1c9a-4148-9564-ab358ce510a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.203884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7af778-1c9a-4148-9564-ab358ce510a3 admin admin] PATH_INFO: `/v3/projects/30d8f7e6f11d49279bbcbb5c0d235e97/users/786bf2732edf430a892963944541ad46/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.226766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7af778-1c9a-4148-9564-ab358ce510a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d8f7e6f11d49279bbcbb5c0d235e97, user_id=786bf2732edf430a892963944541ad46, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:39.229772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7af778-1c9a-4148-9564-ab358ce510a3 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:39.252249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1274/2565] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:39 2022] PUT /identity/v3/projects/30d8f7e6f11d49279bbcbb5c0d235e97/users/786bf2732edf430a892963944541ad46/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:39.256446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7af778-1c9a-4148-9564-ab358ce510a3 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:39.262206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:39.262651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818722a3-91e8-42c0-9459-6597566da73c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:39.340417 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3d726-4ca3-4fc2-83d1-1b9cfa34b0d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:39.341788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3d726-4ca3-4fc2-83d1-1b9cfa34b0d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.342207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3d726-4ca3-4fc2-83d1-1b9cfa34b0d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.342665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3d726-4ca3-4fc2-83d1-1b9cfa34b0d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.348473 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7af778-1c9a-4148-9564-ab358ce510a3 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:39.355611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb809629-0911-4d76-9363-7e63ec209c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:39.356335 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb809629-0911-4d76-9363-7e63ec209c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.356618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb809629-0911-4d76-9363-7e63ec209c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.357563 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb809629-0911-4d76-9363-7e63ec209c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.357970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb809629-0911-4d76-9363-7e63ec209c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:39.361286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb809629-0911-4d76-9363-7e63ec209c0b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:39.363243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3d726-4ca3-4fc2-83d1-1b9cfa34b0d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:39.365958 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3d726-4ca3-4fc2-83d1-1b9cfa34b0d5 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:39.375458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1275/2566] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:23:39.379794 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da07883-0cb5-4f00-98e0-b7f593258461 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.380082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da07883-0cb5-4f00-98e0-b7f593258461 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.380351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da07883-0cb5-4f00-98e0-b7f593258461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.384750 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1292/2567] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:39.387269 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3d726-4ca3-4fc2-83d1-1b9cfa34b0d5 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:39.399760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3d726-4ca3-4fc2-83d1-1b9cfa34b0d5 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:39.406414 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83760190-6e51-47ee-8b2b-d091c2f8fb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:39.407377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83760190-6e51-47ee-8b2b-d091c2f8fb6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.408584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83760190-6e51-47ee-8b2b-d091c2f8fb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.408880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83760190-6e51-47ee-8b2b-d091c2f8fb6f admin admin] PATH_INFO: `/v3/projects/30d8f7e6f11d49279bbcbb5c0d235e97/users/786bf2732edf430a892963944541ad46/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.411997 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83760190-6e51-47ee-8b2b-d091c2f8fb6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d8f7e6f11d49279bbcbb5c0d235e97, user_id=786bf2732edf430a892963944541ad46, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:39.414763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83760190-6e51-47ee-8b2b-d091c2f8fb6f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:39.418407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:39.434209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6da07883-0cb5-4f00-98e0-b7f593258461 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:39.434891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1293/2568] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:39 2022] PUT /identity/v3/projects/30d8f7e6f11d49279bbcbb5c0d235e97/users/786bf2732edf430a892963944541ad46/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:39.441304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6da07883-0cb5-4f00-98e0-b7f593258461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:39.445366 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25f5de-2432-47b4-92a6-fd79df789ee0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.445663 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25f5de-2432-47b4-92a6-fd79df789ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.445928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25f5de-2432-47b4-92a6-fd79df789ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.485492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3e25f5de-2432-47b4-92a6-fd79df789ee0 None None] MFA Rules not processed for user `786bf2732edf430a892963944541ad46`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:39.486756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3e25f5de-2432-47b4-92a6-fd79df789ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:39.540396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1276/2569] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 28 03:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:39.566101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da07883-0cb5-4f00-98e0-b7f593258461 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:39.567606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6da07883-0cb5-4f00-98e0-b7f593258461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:39.606425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1294/2570] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:39.620600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25f5de-2432-47b4-92a6-fd79df789ee0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:39.623298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3e25f5de-2432-47b4-92a6-fd79df789ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:39.742846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da07883-0cb5-4f00-98e0-b7f593258461 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:39.750624 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156459d-d81a-47c8-abe9-bbdfa0495fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:39.751308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156459d-d81a-47c8-abe9-bbdfa0495fc4 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.751643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156459d-d81a-47c8-abe9-bbdfa0495fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.751865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156459d-d81a-47c8-abe9-bbdfa0495fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.767369 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156459d-d81a-47c8-abe9-bbdfa0495fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:39.771289 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156459d-d81a-47c8-abe9-bbdfa0495fc4 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:39.773024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25f5de-2432-47b4-92a6-fd79df789ee0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:39.793837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d0866-43a2-4cf6-b0dd-7780b2751afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:39.794552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0866-43a2-4cf6-b0dd-7780b2751afb service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.794870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0866-43a2-4cf6-b0dd-7780b2751afb service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.795097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0866-43a2-4cf6-b0dd-7780b2751afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.795996 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1277/2571] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:23:39.827251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d0866-43a2-4cf6-b0dd-7780b2751afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:39.828729 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d0866-43a2-4cf6-b0dd-7780b2751afb service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:39.856731 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1295/2572] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:39.886337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156459d-d81a-47c8-abe9-bbdfa0495fc4 service nova] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:39.889292 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7156459d-d81a-47c8-abe9-bbdfa0495fc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:39.906719 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156459d-d81a-47c8-abe9-bbdfa0495fc4 service nova] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:39.912262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:39.913175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.913428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.913696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] PATH_INFO: `/v3/projects/4daa577635f847b18dd5acae415a5819` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.915247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4daa577635f847b18dd5acae415a5819)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:39.917242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:39.935297 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d0866-43a2-4cf6-b0dd-7780b2751afb service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:39.936995 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a45d0866-43a2-4cf6-b0dd-7780b2751afb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:39.954742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d0866-43a2-4cf6-b0dd-7780b2751afb service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:39.969059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc3d3f-ff81-4619-abc9-25246b2d9561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:39.969868 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc3d3f-ff81-4619-abc9-25246b2d9561 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:39.972375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc3d3f-ff81-4619-abc9-25246b2d9561 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:39.972691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc3d3f-ff81-4619-abc9-25246b2d9561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:39.973743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:39.978323 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-90dc3d3f-ff81-4619-abc9-25246b2d9561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:40.023743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4daa577635f847b18dd5acae415a5819', 'request_id': 'req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:40.038565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4daa577635f847b18dd5acae415a5819', 'request_id': 'req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:40.065103 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4daa577635f847b18dd5acae415a5819', 'request_id': 'req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:40.112363 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] The token cache is being invalidate because project 4daa577635f847b18dd5acae415a5819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:40.112656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:40.114617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:40.120063 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1278/2573] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:39 2022] DELETE /identity/v3/projects/4daa577635f847b18dd5acae415a5819 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:40.123699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:40.126684 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:40.155092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc3d3f-ff81-4619-abc9-25246b2d9561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:40.157278 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc3d3f-ff81-4619-abc9-25246b2d9561 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:40.172797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1296/2574] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:40.223715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8d7c7-354d-4af4-a0e8-b9bb62ebb1ae admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:40.229012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c2364-297d-4943-846e-b46a2caeb17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:40.230038 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c2364-297d-4943-846e-b46a2caeb17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:40.230330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c2364-297d-4943-846e-b46a2caeb17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:40.230605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c2364-297d-4943-846e-b46a2caeb17f admin admin] PATH_INFO: `/v3/users/1e2cc732e7f040f0aac8faa8ed50b5b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:40.232662 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c2364-297d-4943-846e-b46a2caeb17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e2cc732e7f040f0aac8faa8ed50b5b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:40.235566 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c2364-297d-4943-846e-b46a2caeb17f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:40.305819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-557c2364-297d-4943-846e-b46a2caeb17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e2cc732e7f040f0aac8faa8ed50b5b7'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:40.306762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-557c2364-297d-4943-846e-b46a2caeb17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e2cc732e7f040f0aac8faa8ed50b5b7'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:40.323512 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-557c2364-297d-4943-846e-b46a2caeb17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e2cc732e7f040f0aac8faa8ed50b5b7'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:40.340264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-557c2364-297d-4943-846e-b46a2caeb17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e2cc732e7f040f0aac8faa8ed50b5b7'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:40.360408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-557c2364-297d-4943-846e-b46a2caeb17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e2cc732e7f040f0aac8faa8ed50b5b7'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:40.373545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1279/2575] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:40 2022] DELETE /identity/v3/users/1e2cc732e7f040f0aac8faa8ed50b5b7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:40.760136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc3d3f-ff81-4619-abc9-25246b2d9561 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:40.774721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc3d3f-ff81-4619-abc9-25246b2d9561 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:40.807755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:40.896500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:40.897425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:40.897706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:40.898151 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] PATH_INFO: `/v3/projects/6d2fe5b6e9f747d28ae9d544e6fbf51d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:40.899372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d2fe5b6e9f747d28ae9d544e6fbf51d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:40.901713 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:41.004963 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d2fe5b6e9f747d28ae9d544e6fbf51d', 'request_id': 'req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:41.016356 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d2fe5b6e9f747d28ae9d544e6fbf51d', 'request_id': 'req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:41.038696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d2fe5b6e9f747d28ae9d544e6fbf51d', 'request_id': 'req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:41.055912 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] The token cache is being invalidate because project 6d2fe5b6e9f747d28ae9d544e6fbf51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:41.056206 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:41.056877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-55d76f66-7ec3-4ae2-b46e-31b341bdff3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:41.066672 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1297/2576] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:40 2022] DELETE /identity/v3/projects/6d2fe5b6e9f747d28ae9d544e6fbf51d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:41.071413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a481a-fef5-46f7-a1c6-9dec729da080 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:41.071948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a481a-fef5-46f7-a1c6-9dec729da080 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:41.071948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a481a-fef5-46f7-a1c6-9dec729da080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:41.100831 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-a50a481a-fef5-46f7-a1c6-9dec729da080 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:41.102163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a50a481a-fef5-46f7-a1c6-9dec729da080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:41.137634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:41.187054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1280/2577] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:41.195273 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075de3e-9171-4eee-b303-2b9385038c8e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:41.195809 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075de3e-9171-4eee-b303-2b9385038c8e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:41.196341 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075de3e-9171-4eee-b303-2b9385038c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:41.220745 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3075de3e-9171-4eee-b303-2b9385038c8e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:41.221977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3075de3e-9171-4eee-b303-2b9385038c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:41.234872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1298/2578] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:41.239965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a481a-fef5-46f7-a1c6-9dec729da080 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:41.250215 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a481a-fef5-46f7-a1c6-9dec729da080 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:41.255938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824efb-15ca-4712-9e07-3872052052b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:41.256614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824efb-15ca-4712-9e07-3872052052b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:41.256909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824efb-15ca-4712-9e07-3872052052b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:41.257196 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824efb-15ca-4712-9e07-3872052052b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:41.257913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8824efb-15ca-4712-9e07-3872052052b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:23:41.258226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8824efb-15ca-4712-9e07-3872052052b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:41.259938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8824efb-15ca-4712-9e07-3872052052b2 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:41.275310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1281/2579] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:23:41.279700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075de3e-9171-4eee-b303-2b9385038c8e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:41.290663 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075de3e-9171-4eee-b303-2b9385038c8e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:41.299243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77b6b8-0682-485f-b793-8043d1855c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:41.299928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77b6b8-0682-485f-b793-8043d1855c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:41.300211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77b6b8-0682-485f-b793-8043d1855c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:41.300727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77b6b8-0682-485f-b793-8043d1855c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:41.301747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77b6b8-0682-485f-b793-8043d1855c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:41.303728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77b6b8-0682-485f-b793-8043d1855c41 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:41.340158 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1299/2580] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:41 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:41.344698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824efb-15ca-4712-9e07-3872052052b2 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:41.355777 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824efb-15ca-4712-9e07-3872052052b2 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:41.426462 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e98be-2228-478a-9622-248987f37d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:41.427551 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e98be-2228-478a-9622-248987f37d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:41.428221 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e98be-2228-478a-9622-248987f37d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:41.428659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e98be-2228-478a-9622-248987f37d2e admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:41.429603 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e98be-2228-478a-9622-248987f37d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:41.431748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e98be-2228-478a-9622-248987f37d2e admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:41.456014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1282/2581] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:41 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:41.460159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77b6b8-0682-485f-b793-8043d1855c41 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:41.472914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77b6b8-0682-485f-b793-8043d1855c41 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:41.484661 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a1258-1e34-47af-b50b-683bbe0e905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:41.485620 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a1258-1e34-47af-b50b-683bbe0e905a admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:41.486066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a1258-1e34-47af-b50b-683bbe0e905a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:41.487146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a1258-1e34-47af-b50b-683bbe0e905a admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:41.487946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a1258-1e34-47af-b50b-683bbe0e905a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:41.489739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a1258-1e34-47af-b50b-683bbe0e905a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:41.508399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1300/2582] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:41.512415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e98be-2228-478a-9622-248987f37d2e admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:41.527827 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e98be-2228-478a-9622-248987f37d2e admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:41.532928 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf17f56-0088-4b54-8767-554081c5fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:41.533737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17f56-0088-4b54-8767-554081c5fbfc admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:41.534020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17f56-0088-4b54-8767-554081c5fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:41.534316 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17f56-0088-4b54-8767-554081c5fbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:41.535275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf17f56-0088-4b54-8767-554081c5fbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:41.541864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf17f56-0088-4b54-8767-554081c5fbfc admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:41.555395 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1283/2583] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:41.559560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a1258-1e34-47af-b50b-683bbe0e905a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:41.570419 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a1258-1e34-47af-b50b-683bbe0e905a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:41.577871 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231ccfb-b458-4b1d-8359-033ad531f869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:41.579065 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231ccfb-b458-4b1d-8359-033ad531f869 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:41.579342 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231ccfb-b458-4b1d-8359-033ad531f869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:41.579630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231ccfb-b458-4b1d-8359-033ad531f869 admin admin] PATH_INFO: `/v3/projects/de051d988e994f9cbf96e7a18282e509/users/f38783170446452ab0be9310ead0e90e/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:41.599670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231ccfb-b458-4b1d-8359-033ad531f869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de051d988e994f9cbf96e7a18282e509, user_id=f38783170446452ab0be9310ead0e90e, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:41.602520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231ccfb-b458-4b1d-8359-033ad531f869 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:41.619939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1301/2584] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:41 2022] PUT /identity/v3/projects/de051d988e994f9cbf96e7a18282e509/users/f38783170446452ab0be9310ead0e90e/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:41.631998 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb52ee-5cb1-43d0-b612-3aa52b63abf1 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:41.632437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb52ee-5cb1-43d0-b612-3aa52b63abf1 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:41.632780 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb52ee-5cb1-43d0-b612-3aa52b63abf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:41.664504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-adeb52ee-5cb1-43d0-b612-3aa52b63abf1 None None] MFA Rules not processed for user `f38783170446452ab0be9310ead0e90e`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:41.666116 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-adeb52ee-5cb1-43d0-b612-3aa52b63abf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:41.784298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1284/2585] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:41.789153 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231ccfb-b458-4b1d-8359-033ad531f869 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:41.863251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:41.881232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231ccfb-b458-4b1d-8359-033ad531f869 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:41.895946 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba233aa-4930-4433-9868-063b7072a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:41.896428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba233aa-4930-4433-9868-063b7072a5bf admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:41.896703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba233aa-4930-4433-9868-063b7072a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:41.896971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba233aa-4930-4433-9868-063b7072a5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:41.897667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba233aa-4930-4433-9868-063b7072a5bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:41.899682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba233aa-4930-4433-9868-063b7072a5bf admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:41.942876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1302/2586] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:41 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:41.946836 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb52ee-5cb1-43d0-b612-3aa52b63abf1 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:41.960444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb52ee-5cb1-43d0-b612-3aa52b63abf1 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:42.011351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:42.085919 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d6364-b5bd-4a84-9e40-06304617514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:42.087554 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d6364-b5bd-4a84-9e40-06304617514a admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:42.087841 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d6364-b5bd-4a84-9e40-06304617514a admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:42.088122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d6364-b5bd-4a84-9e40-06304617514a admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:42.089096 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d6364-b5bd-4a84-9e40-06304617514a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:42.091072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d6364-b5bd-4a84-9e40-06304617514a admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:42.152102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1285/2587] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:41 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:42.153617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba233aa-4930-4433-9868-063b7072a5bf admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:42.170646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba233aa-4930-4433-9868-063b7072a5bf admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:42.191880 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8685b-55ec-4eeb-93f7-f1b3abf7543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:42.193026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8685b-55ec-4eeb-93f7-f1b3abf7543d admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:42.193438 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8685b-55ec-4eeb-93f7-f1b3abf7543d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:42.193806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8685b-55ec-4eeb-93f7-f1b3abf7543d admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:42.194692 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8685b-55ec-4eeb-93f7-f1b3abf7543d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:42.196623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8685b-55ec-4eeb-93f7-f1b3abf7543d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:42.218691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1303/2588] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:23:42.223450 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d6364-b5bd-4a84-9e40-06304617514a admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:42.235614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d6364-b5bd-4a84-9e40-06304617514a admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:42.246620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921677e-1e34-4fb0-8501-864c1abc18d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:42.247609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921677e-1e34-4fb0-8501-864c1abc18d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:42.247899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921677e-1e34-4fb0-8501-864c1abc18d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:42.250817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921677e-1e34-4fb0-8501-864c1abc18d8 admin admin] PATH_INFO: `/v3/projects/d863a8ccd5a54f909772072b129a8f29/users/eca1d2509d3b4b809f31fe79446248ad/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:42.273904 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921677e-1e34-4fb0-8501-864c1abc18d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d863a8ccd5a54f909772072b129a8f29, user_id=eca1d2509d3b4b809f31fe79446248ad, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:42.276921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921677e-1e34-4fb0-8501-864c1abc18d8 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:42.305710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1286/2589] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:42 2022] PUT /identity/v3/projects/d863a8ccd5a54f909772072b129a8f29/users/eca1d2509d3b4b809f31fe79446248ad/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:42.311434 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8685b-55ec-4eeb-93f7-f1b3abf7543d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:42.329590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8685b-55ec-4eeb-93f7-f1b3abf7543d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:42.419569 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6181a2-dd8a-4321-9f55-c3c687116f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:42.420385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6181a2-dd8a-4321-9f55-c3c687116f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:42.420739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6181a2-dd8a-4321-9f55-c3c687116f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:42.421201 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6181a2-dd8a-4321-9f55-c3c687116f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:42.424325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6181a2-dd8a-4321-9f55-c3c687116f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:42.424325 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6181a2-dd8a-4321-9f55-c3c687116f97 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:42.438763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1304/2590] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:42.442906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921677e-1e34-4fb0-8501-864c1abc18d8 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:42.455467 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921677e-1e34-4fb0-8501-864c1abc18d8 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:42.461431 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3d7a3-5ee3-4c40-b9eb-e0bcd154d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:42.462554 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3d7a3-5ee3-4c40-b9eb-e0bcd154d6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:42.463094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3d7a3-5ee3-4c40-b9eb-e0bcd154d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:42.463485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3d7a3-5ee3-4c40-b9eb-e0bcd154d6aa admin admin] PATH_INFO: `/v3/projects/d863a8ccd5a54f909772072b129a8f29/users/eca1d2509d3b4b809f31fe79446248ad/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:42.465944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3d7a3-5ee3-4c40-b9eb-e0bcd154d6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d863a8ccd5a54f909772072b129a8f29, user_id=eca1d2509d3b4b809f31fe79446248ad, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:42.472722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3d7a3-5ee3-4c40-b9eb-e0bcd154d6aa admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:42.485452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1287/2591] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:42 2022] PUT /identity/v3/projects/d863a8ccd5a54f909772072b129a8f29/users/eca1d2509d3b4b809f31fe79446248ad/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:42.494530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208eac5-f77a-479d-bd2a-b8191aabd6cc None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:42.494825 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208eac5-f77a-479d-bd2a-b8191aabd6cc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:42.495702 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208eac5-f77a-479d-bd2a-b8191aabd6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:42.531865 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e208eac5-f77a-479d-bd2a-b8191aabd6cc None None] MFA Rules not processed for user `eca1d2509d3b4b809f31fe79446248ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:42.533033 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e208eac5-f77a-479d-bd2a-b8191aabd6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:42.621951 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1305/2592] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:42.634163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3d7a3-5ee3-4c40-b9eb-e0bcd154d6aa admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:42.636431 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bfe3d7a3-5ee3-4c40-b9eb-e0bcd154d6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:42.717382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3d7a3-5ee3-4c40-b9eb-e0bcd154d6aa admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:42.721914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a5773-6ebb-4e45-97bb-8d4c5c198e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:42.722638 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a5773-6ebb-4e45-97bb-8d4c5c198e33 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:42.723014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a5773-6ebb-4e45-97bb-8d4c5c198e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:42.723291 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a5773-6ebb-4e45-97bb-8d4c5c198e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:42.735407 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a5773-6ebb-4e45-97bb-8d4c5c198e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:42.736879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a5773-6ebb-4e45-97bb-8d4c5c198e33 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:42.747100 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1288/2593] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:43.153507 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208eac5-f77a-479d-bd2a-b8191aabd6cc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:43.212221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:43.231934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208eac5-f77a-479d-bd2a-b8191aabd6cc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:43.237059 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:43.238228 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:43.238537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:43.238806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] PATH_INFO: `/v3/users/f38783170446452ab0be9310ead0e90e` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:43.240342 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38783170446452ab0be9310ead0e90e)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:43.242656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:43.302442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38783170446452ab0be9310ead0e90e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:43.302795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38783170446452ab0be9310ead0e90e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:43.313594 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38783170446452ab0be9310ead0e90e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:43.331768 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38783170446452ab0be9310ead0e90e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:43.345840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38783170446452ab0be9310ead0e90e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:43.357769 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1306/2594] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:43 2022] DELETE /identity/v3/users/f38783170446452ab0be9310ead0e90e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:43.359723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd91da-1a2e-47cd-922e-5fed014043f6 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:43.360193 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd91da-1a2e-47cd-922e-5fed014043f6 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:43.360670 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd91da-1a2e-47cd-922e-5fed014043f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:43.397950 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-afcd91da-1a2e-47cd-922e-5fed014043f6 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:43.399850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-afcd91da-1a2e-47cd-922e-5fed014043f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:43.508879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:43.511336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:43.532646 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1289/2595] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:43.550095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd91da-1a2e-47cd-922e-5fed014043f6 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:43.552926 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-afcd91da-1a2e-47cd-922e-5fed014043f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:43.586798 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:43.616761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707110ac-19b9-424b-8599-39d6b9c80951 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:43.622400 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d56e73-dc0e-4552-a25f-d34e478b25ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:43.623494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d56e73-dc0e-4552-a25f-d34e478b25ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:43.623775 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d56e73-dc0e-4552-a25f-d34e478b25ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:43.624048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d56e73-dc0e-4552-a25f-d34e478b25ab admin admin] PATH_INFO: `/v3/users/36fe58f8d4e248d1877ef64515d02a7b` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:43.625829 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d56e73-dc0e-4552-a25f-d34e478b25ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fe58f8d4e248d1877ef64515d02a7b)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:43.627778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d56e73-dc0e-4552-a25f-d34e478b25ab admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:43.638888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd91da-1a2e-47cd-922e-5fed014043f6 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:43.643390 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b4823-3ef9-41d4-b9fe-f579d0b045fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:43.644287 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b4823-3ef9-41d4-b9fe-f579d0b045fb service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:43.644574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b4823-3ef9-41d4-b9fe-f579d0b045fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:43.644852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b4823-3ef9-41d4-b9fe-f579d0b045fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:43.656275 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b4823-3ef9-41d4-b9fe-f579d0b045fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:43.658244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b4823-3ef9-41d4-b9fe-f579d0b045fb service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:43.672031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1290/2596] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:23:43.673434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce9449-1818-4206-a05f-567b29d6f348 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:43.673723 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce9449-1818-4206-a05f-567b29d6f348 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:43.674053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce9449-1818-4206-a05f-567b29d6f348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:43.705958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-ddce9449-1818-4206-a05f-567b29d6f348 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:43.707548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ddce9449-1818-4206-a05f-567b29d6f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:43.717278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1291/2597] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 28 03:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:43.724834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-79d56e73-dc0e-4552-a25f-d34e478b25ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fe58f8d4e248d1877ef64515d02a7b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:43.726492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-79d56e73-dc0e-4552-a25f-d34e478b25ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fe58f8d4e248d1877ef64515d02a7b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:43.741287 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-79d56e73-dc0e-4552-a25f-d34e478b25ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fe58f8d4e248d1877ef64515d02a7b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:43.742415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce9449-1818-4206-a05f-567b29d6f348 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:43.743922 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ddce9449-1818-4206-a05f-567b29d6f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:43.765250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:43.783546 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-79d56e73-dc0e-4552-a25f-d34e478b25ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fe58f8d4e248d1877ef64515d02a7b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:43.796408 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-79d56e73-dc0e-4552-a25f-d34e478b25ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fe58f8d4e248d1877ef64515d02a7b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:43.811329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1307/2598] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:43 2022] DELETE /identity/v3/users/36fe58f8d4e248d1877ef64515d02a7b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:43.822335 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5b63e-ce22-4293-9cd5-0d99bf0913e8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:43.822641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5b63e-ce22-4293-9cd5-0d99bf0913e8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:43.822922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5b63e-ce22-4293-9cd5-0d99bf0913e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:43.854089 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-36f5b63e-ce22-4293-9cd5-0d99bf0913e8 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:43.856180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-36f5b63e-ce22-4293-9cd5-0d99bf0913e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:43.874952 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce9449-1818-4206-a05f-567b29d6f348 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:43.951373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1308/2599] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:43.965572 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5b63e-ce22-4293-9cd5-0d99bf0913e8 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:43.969679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-36f5b63e-ce22-4293-9cd5-0d99bf0913e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:43.986354 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fc846-26bc-46a0-9908-070698b05a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:43.987425 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fc846-26bc-46a0-9908-070698b05a96 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:43.987752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fc846-26bc-46a0-9908-070698b05a96 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:43.988054 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fc846-26bc-46a0-9908-070698b05a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:43.989979 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-753fc846-26bc-46a0-9908-070698b05a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:44.004135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fc846-26bc-46a0-9908-070698b05a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:44.005913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fc846-26bc-46a0-9908-070698b05a96 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:44.022725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1292/2600] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:23:44.037471 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fc846-26bc-46a0-9908-070698b05a96 service nova] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:44.039413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-753fc846-26bc-46a0-9908-070698b05a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:44.063726 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fc846-26bc-46a0-9908-070698b05a96 service nova] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:44.084165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5b63e-ce22-4293-9cd5-0d99bf0913e8 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:44.084660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:44.085693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:44.085962 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:44.086237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] PATH_INFO: `/v3/projects/de051d988e994f9cbf96e7a18282e509` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:44.088277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=de051d988e994f9cbf96e7a18282e509)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:44.088394 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5482-ea04-46a9-9244-ee740c777c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:44.089045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5482-ea04-46a9-9244-ee740c777c27 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:44.089395 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5482-ea04-46a9-9244-ee740c777c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:44.089759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5482-ea04-46a9-9244-ee740c777c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:44.090283 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:44.101608 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b5482-ea04-46a9-9244-ee740c777c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:44.103226 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b5482-ea04-46a9-9244-ee740c777c27 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:44.120820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1309/2601] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:23:44.161326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:44.174863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de051d988e994f9cbf96e7a18282e509', 'request_id': 'req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.185092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de051d988e994f9cbf96e7a18282e509', 'request_id': 'req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.226681 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de051d988e994f9cbf96e7a18282e509', 'request_id': 'req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.243549 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] The token cache is being invalidate because project de051d988e994f9cbf96e7a18282e509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:44.243880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.244995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.246414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1293/2602] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:44 2022] DELETE /identity/v3/projects/de051d988e994f9cbf96e7a18282e509 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:44.253237 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5482-ea04-46a9-9244-ee740c777c27 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:44.263173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5482-ea04-46a9-9244-ee740c777c27 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:44.334747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:44.335890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:44.336438 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:44.336787 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] PATH_INFO: `/v3/users/eca1d2509d3b4b809f31fe79446248ad` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:44.338917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eca1d2509d3b4b809f31fe79446248ad)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:44.340966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:44.382506 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:44.416111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eca1d2509d3b4b809f31fe79446248ad'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.417749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eca1d2509d3b4b809f31fe79446248ad'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.434187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eca1d2509d3b4b809f31fe79446248ad'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.453580 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eca1d2509d3b4b809f31fe79446248ad'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.462820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eca1d2509d3b4b809f31fe79446248ad'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.474067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1310/2603] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:44 2022] DELETE /identity/v3/users/eca1d2509d3b4b809f31fe79446248ad => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:44.499595 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:44.501053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:44.521863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1dc63-f958-47d7-9ef8-e37fb87a11ce admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:44.625176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:44.626399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:44.626725 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:44.627015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] PATH_INFO: `/v3/projects/26228e518e9149aba3967d1441918b39` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:44.628687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26228e518e9149aba3967d1441918b39)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:44.630383 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:44.691068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26228e518e9149aba3967d1441918b39', 'request_id': 'req-bd206e1a-bbff-4474-b729-08e183f0c734'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.699907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26228e518e9149aba3967d1441918b39', 'request_id': 'req-bd206e1a-bbff-4474-b729-08e183f0c734'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.731384 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26228e518e9149aba3967d1441918b39', 'request_id': 'req-bd206e1a-bbff-4474-b729-08e183f0c734'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.749864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] The token cache is being invalidate because project 26228e518e9149aba3967d1441918b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:44.750228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.753850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.755691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1294/2604] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:44 2022] DELETE /identity/v3/projects/26228e518e9149aba3967d1441918b39 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:44.759894 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:44.761397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:44.783931 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab46c2b-62f3-46dd-b55f-90f4f4324646 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:44.895687 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:44.897125 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:44.909913 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7739420-e6cb-46e7-bc46-f75e27c2ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:44.910901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7739420-e6cb-46e7-bc46-f75e27c2ab5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:44.911168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7739420-e6cb-46e7-bc46-f75e27c2ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:44.911443 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7739420-e6cb-46e7-bc46-f75e27c2ab5d admin admin] PATH_INFO: `/v3/users/742f98dfafb94cf386ac70b6439f77fd` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:44.913969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7739420-e6cb-46e7-bc46-f75e27c2ab5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=742f98dfafb94cf386ac70b6439f77fd)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:44.916161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7739420-e6cb-46e7-bc46-f75e27c2ab5d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:44.984169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c7739420-e6cb-46e7-bc46-f75e27c2ab5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742f98dfafb94cf386ac70b6439f77fd'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.986142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c7739420-e6cb-46e7-bc46-f75e27c2ab5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742f98dfafb94cf386ac70b6439f77fd'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:44.998717 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c7739420-e6cb-46e7-bc46-f75e27c2ab5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742f98dfafb94cf386ac70b6439f77fd'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.014626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:45.018899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c7739420-e6cb-46e7-bc46-f75e27c2ab5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742f98dfafb94cf386ac70b6439f77fd'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.027658 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c7739420-e6cb-46e7-bc46-f75e27c2ab5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742f98dfafb94cf386ac70b6439f77fd'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.034464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd206e1a-bbff-4474-b729-08e183f0c734 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:45.037377 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1311/2605] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:44 2022] DELETE /identity/v3/users/742f98dfafb94cf386ac70b6439f77fd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:45.139669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:45.140583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:45.141135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:45.141135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] PATH_INFO: `/v3/projects/d863a8ccd5a54f909772072b129a8f29` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:45.142583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d863a8ccd5a54f909772072b129a8f29)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:45.145433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:45.211696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd863a8ccd5a54f909772072b129a8f29', 'request_id': 'req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.219242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd863a8ccd5a54f909772072b129a8f29', 'request_id': 'req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.235761 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd863a8ccd5a54f909772072b129a8f29', 'request_id': 'req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.251222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] The token cache is being invalidate because project d863a8ccd5a54f909772072b129a8f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:45.251560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.252216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d3f6d4e3-b0d8-44af-b219-a3e2517af0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.254222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1295/2606] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:44 2022] DELETE /identity/v3/projects/d863a8ccd5a54f909772072b129a8f29 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:45.259995 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2c402-47b8-4bff-826e-77ebe9f9d0fd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:45.260556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2c402-47b8-4bff-826e-77ebe9f9d0fd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:45.261101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2c402-47b8-4bff-826e-77ebe9f9d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:45.283687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-bea2c402-47b8-4bff-826e-77ebe9f9d0fd None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:45.283687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bea2c402-47b8-4bff-826e-77ebe9f9d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:45.309921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:45.369241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1312/2607] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:45.391162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70b1e5-5fbe-45d9-9a03-fba6b99810fd None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:45.391523 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70b1e5-5fbe-45d9-9a03-fba6b99810fd None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:45.391956 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70b1e5-5fbe-45d9-9a03-fba6b99810fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:45.408833 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2c402-47b8-4bff-826e-77ebe9f9d0fd None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:45.410353 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bea2c402-47b8-4bff-826e-77ebe9f9d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:45.422989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2c402-47b8-4bff-826e-77ebe9f9d0fd None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:45.428141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5c70b1e5-5fbe-45d9-9a03-fba6b99810fd None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:45.429565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5c70b1e5-5fbe-45d9-9a03-fba6b99810fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:45.432210 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:45.435885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:45.436166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:45.436441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] PATH_INFO: `/v3/projects/22fc3ca4eeb24e7cb757f7f23849e9c1` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:45.440378 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1296/2608] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:45.440552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22fc3ca4eeb24e7cb757f7f23849e9c1)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:45.442589 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:45.444135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70b1e5-5fbe-45d9-9a03-fba6b99810fd None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:45.461672 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70b1e5-5fbe-45d9-9a03-fba6b99810fd None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:45.471130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e6fcf-855a-40a9-bd77-aea5b890fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:45.472095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e6fcf-855a-40a9-bd77-aea5b890fad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:45.472579 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e6fcf-855a-40a9-bd77-aea5b890fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:45.473179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e6fcf-855a-40a9-bd77-aea5b890fad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:45.473659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e6fcf-855a-40a9-bd77-aea5b890fad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:23:45.474020 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e6fcf-855a-40a9-bd77-aea5b890fad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:45.481395 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e6fcf-855a-40a9-bd77-aea5b890fad3 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:45.502189 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1297/2609] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:23:45.505284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e6fcf-855a-40a9-bd77-aea5b890fad3 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:45.525513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e6fcf-855a-40a9-bd77-aea5b890fad3 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:45.530736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22fc3ca4eeb24e7cb757f7f23849e9c1', 'request_id': 'req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.538642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22fc3ca4eeb24e7cb757f7f23849e9c1', 'request_id': 'req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.549368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22fc3ca4eeb24e7cb757f7f23849e9c1', 'request_id': 'req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.563887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] The token cache is being invalidate because project 22fc3ca4eeb24e7cb757f7f23849e9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:45.564178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.565215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.567367 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1313/2610] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:45 2022] DELETE /identity/v3/projects/22fc3ca4eeb24e7cb757f7f23849e9c1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:45.571256 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:45.573025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:45.604373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63592a-3dd5-4d74-856c-f5fa9ec2a9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:45.605055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63592a-3dd5-4d74-856c-f5fa9ec2a9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:45.605337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63592a-3dd5-4d74-856c-f5fa9ec2a9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:45.605605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63592a-3dd5-4d74-856c-f5fa9ec2a9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:45.606319 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63592a-3dd5-4d74-856c-f5fa9ec2a9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:45.608424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63592a-3dd5-4d74-856c-f5fa9ec2a9b5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:45.629255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:45.655160 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1298/2611] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:45 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:45.660076 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63592a-3dd5-4d74-856c-f5fa9ec2a9b5 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:45.661215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f5a0-a8f4-4fa2-850a-50c01d4637d0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:45.663532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ba63592a-3dd5-4d74-856c-f5fa9ec2a9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:45.737654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:45.742320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63592a-3dd5-4d74-856c-f5fa9ec2a9b5 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:45.749227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25623eef-e0d5-422f-97c6-546b6c106104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:45.749725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bba0dc-0847-4cec-9eed-bfd8e27d7d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:45.750053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25623eef-e0d5-422f-97c6-546b6c106104 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:45.750403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25623eef-e0d5-422f-97c6-546b6c106104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:45.750638 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25623eef-e0d5-422f-97c6-546b6c106104 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:45.750846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bba0dc-0847-4cec-9eed-bfd8e27d7d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:45.751134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bba0dc-0847-4cec-9eed-bfd8e27d7d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:45.751381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25623eef-e0d5-422f-97c6-546b6c106104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:45.751490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bba0dc-0847-4cec-9eed-bfd8e27d7d28 admin admin] PATH_INFO: `/v3/users/786bf2732edf430a892963944541ad46` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:45.752841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bba0dc-0847-4cec-9eed-bfd8e27d7d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=786bf2732edf430a892963944541ad46)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:45.753643 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25623eef-e0d5-422f-97c6-546b6c106104 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:45.755491 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bba0dc-0847-4cec-9eed-bfd8e27d7d28 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:45.785491 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1299/2612] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:45 2022] POST /identity/v3/users => generated 284 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:45.787135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25623eef-e0d5-422f-97c6-546b6c106104 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:45.798183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25623eef-e0d5-422f-97c6-546b6c106104 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:45.804010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0fa9b-db88-4426-8e25-bcf5be490592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:45.804850 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0fa9b-db88-4426-8e25-bcf5be490592 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:45.805077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0fa9b-db88-4426-8e25-bcf5be490592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:45.805352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0fa9b-db88-4426-8e25-bcf5be490592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:45.806107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0fa9b-db88-4426-8e25-bcf5be490592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:45.807788 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0fa9b-db88-4426-8e25-bcf5be490592 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:45.822639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1300/2613] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:23:45.824098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0fa9b-db88-4426-8e25-bcf5be490592 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:45.830051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-78bba0dc-0847-4cec-9eed-bfd8e27d7d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '786bf2732edf430a892963944541ad46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.830819 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-78bba0dc-0847-4cec-9eed-bfd8e27d7d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '786bf2732edf430a892963944541ad46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.841941 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0fa9b-db88-4426-8e25-bcf5be490592 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:45.845784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-78bba0dc-0847-4cec-9eed-bfd8e27d7d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '786bf2732edf430a892963944541ad46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.850225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac08c4-5b85-41d5-8153-06d426987f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:45.850964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac08c4-5b85-41d5-8153-06d426987f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:45.851243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac08c4-5b85-41d5-8153-06d426987f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:45.851498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac08c4-5b85-41d5-8153-06d426987f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:45.853460 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac08c4-5b85-41d5-8153-06d426987f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:45.855072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac08c4-5b85-41d5-8153-06d426987f9f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:45.870933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1301/2614] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:45.872124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac08c4-5b85-41d5-8153-06d426987f9f admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:45.873582 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-78bba0dc-0847-4cec-9eed-bfd8e27d7d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '786bf2732edf430a892963944541ad46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.885055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-78bba0dc-0847-4cec-9eed-bfd8e27d7d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '786bf2732edf430a892963944541ad46'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:45.889886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac08c4-5b85-41d5-8153-06d426987f9f admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:45.896632 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1314/2615] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:45 2022] DELETE /identity/v3/users/786bf2732edf430a892963944541ad46 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:45.991005 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef1a27-ce32-4727-9c1f-c74fa6f59e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:45.992002 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef1a27-ce32-4727-9c1f-c74fa6f59e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:45.993484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef1a27-ce32-4727-9c1f-c74fa6f59e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:45.993854 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef1a27-ce32-4727-9c1f-c74fa6f59e36 admin admin] PATH_INFO: `/v3/projects/b31afea845124db8a607bef4037fe041/users/37ec7a59220248bc8be66eaea6f345c2/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:46.025158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef1a27-ce32-4727-9c1f-c74fa6f59e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31afea845124db8a607bef4037fe041, user_id=37ec7a59220248bc8be66eaea6f345c2, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:46.029033 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef1a27-ce32-4727-9c1f-c74fa6f59e36 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:46.054816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1302/2616] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:45 2022] PUT /identity/v3/projects/b31afea845124db8a607bef4037fe041/users/37ec7a59220248bc8be66eaea6f345c2/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:46.067674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdc987-4c52-44c1-bfbd-164318683d25 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:46.067996 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdc987-4c52-44c1-bfbd-164318683d25 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:46.069194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdc987-4c52-44c1-bfbd-164318683d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:46.072331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef1a27-ce32-4727-9c1f-c74fa6f59e36 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:46.078842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cfef1a27-ce32-4727-9c1f-c74fa6f59e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:46.142364 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7bfdc987-4c52-44c1-bfbd-164318683d25 None None] MFA Rules not processed for user `37ec7a59220248bc8be66eaea6f345c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:46.146093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7bfdc987-4c52-44c1-bfbd-164318683d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:46.163591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:46.172129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef1a27-ce32-4727-9c1f-c74fa6f59e36 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:46.177799 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf321a-9c35-4365-b1f5-3e97b2353ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:46.179226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf321a-9c35-4365-b1f5-3e97b2353ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:46.179520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf321a-9c35-4365-b1f5-3e97b2353ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:46.180169 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf321a-9c35-4365-b1f5-3e97b2353ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:46.184976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f9bf321a-9c35-4365-b1f5-3e97b2353ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:46.269427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1315/2617] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:46.288539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdc987-4c52-44c1-bfbd-164318683d25 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:46.292850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7bfdc987-4c52-44c1-bfbd-164318683d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:46.321385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf321a-9c35-4365-b1f5-3e97b2353ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:46.323044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf321a-9c35-4365-b1f5-3e97b2353ee6 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:46.335281 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1303/2618] 10.222.0.23 () {60 vars in 1396 bytes} [Tue Jun 28 03:23:46 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:46.336357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf321a-9c35-4365-b1f5-3e97b2353ee6 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:46.338544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f9bf321a-9c35-4365-b1f5-3e97b2353ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:46.458786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdc987-4c52-44c1-bfbd-164318683d25 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:46.462847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b74626-141d-4fa7-8857-e06d028b3b8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70604923ae0b4a4dae21de1314cddbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:46.463584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b74626-141d-4fa7-8857-e06d028b3b8d service glance] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:46.463870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b74626-141d-4fa7-8857-e06d028b3b8d service glance] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:46.464147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b74626-141d-4fa7-8857-e06d028b3b8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:46.473615 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:46.476576 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b74626-141d-4fa7-8857-e06d028b3b8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:46.478736 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b74626-141d-4fa7-8857-e06d028b3b8d service glance] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:46.481315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf321a-9c35-4365-b1f5-3e97b2353ee6 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:46.492223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1316/2619] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:46.496428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:46.497813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:46.498207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:46.498573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] PATH_INFO: `/v3/projects/30d8f7e6f11d49279bbcbb5c0d235e97` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:46.500107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d8f7e6f11d49279bbcbb5c0d235e97)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:46.502090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:46.614313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d8f7e6f11d49279bbcbb5c0d235e97', 'request_id': 'req-aecf777d-da48-4133-9f87-32981375c203'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:46.623097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d8f7e6f11d49279bbcbb5c0d235e97', 'request_id': 'req-aecf777d-da48-4133-9f87-32981375c203'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:46.637026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d8f7e6f11d49279bbcbb5c0d235e97', 'request_id': 'req-aecf777d-da48-4133-9f87-32981375c203'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:46.657774 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] The token cache is being invalidate because project 30d8f7e6f11d49279bbcbb5c0d235e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:46.658182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:46.658937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-aecf777d-da48-4133-9f87-32981375c203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:46.661037 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1304/2620] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:46 2022] DELETE /identity/v3/projects/30d8f7e6f11d49279bbcbb5c0d235e97 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:46.669429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c4ad3-6aa2-42e5-bd8a-f34aece41bab None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:46.669725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c4ad3-6aa2-42e5-bd8a-f34aece41bab None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:46.670002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c4ad3-6aa2-42e5-bd8a-f34aece41bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:46.708217 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-231c4ad3-6aa2-42e5-bd8a-f34aece41bab None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:46.709372 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-231c4ad3-6aa2-42e5-bd8a-f34aece41bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:46.806468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1317/2621] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:46.811006 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087c16-3df1-4f95-8395-f0660ac5c893 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:46.811295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087c16-3df1-4f95-8395-f0660ac5c893 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:46.811626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087c16-3df1-4f95-8395-f0660ac5c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:46.841598 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5a087c16-3df1-4f95-8395-f0660ac5c893 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:46.842942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5a087c16-3df1-4f95-8395-f0660ac5c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:46.859315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1305/2622] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:46.860155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c4ad3-6aa2-42e5-bd8a-f34aece41bab None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:46.882623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c4ad3-6aa2-42e5-bd8a-f34aece41bab None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:46.891602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b2284-20d8-460a-8dda-4380694999b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:46.893617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b2284-20d8-460a-8dda-4380694999b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:46.893900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b2284-20d8-460a-8dda-4380694999b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:46.894771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b2284-20d8-460a-8dda-4380694999b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:46.895534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b2284-20d8-460a-8dda-4380694999b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:23:46.895864 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b2284-20d8-460a-8dda-4380694999b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:46.897561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b2284-20d8-460a-8dda-4380694999b7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:46.925469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087c16-3df1-4f95-8395-f0660ac5c893 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:46.936030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1318/2623] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:23:46.939771 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087c16-3df1-4f95-8395-f0660ac5c893 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:46.947213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8224833-4c11-49f3-a2ee-838fa0398a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:46.947960 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8224833-4c11-49f3-a2ee-838fa0398a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:46.948262 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8224833-4c11-49f3-a2ee-838fa0398a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:46.948504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8224833-4c11-49f3-a2ee-838fa0398a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:46.949263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8224833-4c11-49f3-a2ee-838fa0398a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:46.951294 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8224833-4c11-49f3-a2ee-838fa0398a4e admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:46.989367 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1306/2624] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:46 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:46.993860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b2284-20d8-460a-8dda-4380694999b7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:47.008730 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b2284-20d8-460a-8dda-4380694999b7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:47.089339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb671d-ff9f-45e7-9bf2-0f22a20d6c79 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:47.089902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb671d-ff9f-45e7-9bf2-0f22a20d6c79 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:47.090387 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb671d-ff9f-45e7-9bf2-0f22a20d6c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:47.099949 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:47.122206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-3fcb671d-ff9f-45e7-9bf2-0f22a20d6c79 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:47.124129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3fcb671d-ff9f-45e7-9bf2-0f22a20d6c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:47.139062 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1512bb-c746-4c4c-aa50-fe7cde0db3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:47.140285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1512bb-c746-4c4c-aa50-fe7cde0db3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:47.140634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1512bb-c746-4c4c-aa50-fe7cde0db3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:47.140978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1512bb-c746-4c4c-aa50-fe7cde0db3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:47.142206 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1512bb-c746-4c4c-aa50-fe7cde0db3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:47.144436 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1512bb-c746-4c4c-aa50-fe7cde0db3a1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:47.170539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1319/2625] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:46 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:47.183363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1512bb-c746-4c4c-aa50-fe7cde0db3a1 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:47.198752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1512bb-c746-4c4c-aa50-fe7cde0db3a1 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:47.205876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5948d2-e67b-4ad5-8f63-d116e698cbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:47.207020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5948d2-e67b-4ad5-8f63-d116e698cbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:47.207483 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5948d2-e67b-4ad5-8f63-d116e698cbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:47.207982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5948d2-e67b-4ad5-8f63-d116e698cbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:47.208910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5948d2-e67b-4ad5-8f63-d116e698cbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:47.210718 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5948d2-e67b-4ad5-8f63-d116e698cbe6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:47.227333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1320/2626] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:47.231333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5948d2-e67b-4ad5-8f63-d116e698cbe6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:47.251715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5948d2-e67b-4ad5-8f63-d116e698cbe6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:47.257113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1307/2627] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 28 03:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:47.260037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835f7a8-1ea3-4927-8daa-8b8f0866adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:47.260789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835f7a8-1ea3-4927-8daa-8b8f0866adc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:47.261132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835f7a8-1ea3-4927-8daa-8b8f0866adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:47.261612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835f7a8-1ea3-4927-8daa-8b8f0866adc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:47.262463 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835f7a8-1ea3-4927-8daa-8b8f0866adc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:47.264765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835f7a8-1ea3-4927-8daa-8b8f0866adc3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:47.282040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb671d-ff9f-45e7-9bf2-0f22a20d6c79 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:47.286739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1321/2628] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:47.289321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835f7a8-1ea3-4927-8daa-8b8f0866adc3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:47.293184 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb671d-ff9f-45e7-9bf2-0f22a20d6c79 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:47.295863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8835f7a8-1ea3-4927-8daa-8b8f0866adc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:47.298572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51714e-e739-47bf-8138-54029996912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:47.299574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51714e-e739-47bf-8138-54029996912b admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:47.299913 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51714e-e739-47bf-8138-54029996912b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:47.300361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51714e-e739-47bf-8138-54029996912b admin admin] PATH_INFO: `/v3/projects/360a47a4fbe74da7b542492f91779b1b/users/d6836d4eb196404f84669b4df02b757d/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:47.320351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51714e-e739-47bf-8138-54029996912b admin admin] RBAC: Authorizing `identity:create_grant(project_id=360a47a4fbe74da7b542492f91779b1b, user_id=d6836d4eb196404f84669b4df02b757d, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:47.324097 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51714e-e739-47bf-8138-54029996912b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:47.345746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1308/2629] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:47 2022] PUT /identity/v3/projects/360a47a4fbe74da7b542492f91779b1b/users/d6836d4eb196404f84669b4df02b757d/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:23:47.359631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c846e42-f03f-4e56-a8cd-3dcd0e0fb454 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:47.360081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c846e42-f03f-4e56-a8cd-3dcd0e0fb454 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:47.360422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c846e42-f03f-4e56-a8cd-3dcd0e0fb454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:47.389679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-2c846e42-f03f-4e56-a8cd-3dcd0e0fb454 None None] MFA Rules not processed for user `d6836d4eb196404f84669b4df02b757d`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:47.391035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-2c846e42-f03f-4e56-a8cd-3dcd0e0fb454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:47.392239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:47.424260 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835f7a8-1ea3-4927-8daa-8b8f0866adc3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:47.481273 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1309/2630] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:47.486386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c846e42-f03f-4e56-a8cd-3dcd0e0fb454 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:47.515363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a44a8-20dd-47f3-bd9a-8d203d90fa27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:47.516034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a44a8-20dd-47f3-bd9a-8d203d90fa27 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:47.516313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a44a8-20dd-47f3-bd9a-8d203d90fa27 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:47.516585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a44a8-20dd-47f3-bd9a-8d203d90fa27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:47.581191 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c846e42-f03f-4e56-a8cd-3dcd0e0fb454 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:47.588829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea417a-c010-4083-93d9-a2d11628f679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:47.589518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea417a-c010-4083-93d9-a2d11628f679 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:47.589796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea417a-c010-4083-93d9-a2d11628f679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:47.590075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea417a-c010-4083-93d9-a2d11628f679 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:47.591080 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea417a-c010-4083-93d9-a2d11628f679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:47.594117 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea417a-c010-4083-93d9-a2d11628f679 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:47.611692 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:47.623322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a44a8-20dd-47f3-bd9a-8d203d90fa27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:47.625599 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a44a8-20dd-47f3-bd9a-8d203d90fa27 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:47.633447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1310/2631] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:23:47 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:23:47.635485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea417a-c010-4083-93d9-a2d11628f679 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:47.639699 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1322/2632] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:47.719484 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea417a-c010-4083-93d9-a2d11628f679 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:47.725092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247dad5-7f94-41b3-991c-1af9d99cd97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:47.725781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247dad5-7f94-41b3-991c-1af9d99cd97e admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:47.726056 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247dad5-7f94-41b3-991c-1af9d99cd97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:47.726361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247dad5-7f94-41b3-991c-1af9d99cd97e admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:47.727061 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247dad5-7f94-41b3-991c-1af9d99cd97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:47.729109 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247dad5-7f94-41b3-991c-1af9d99cd97e admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:47.776030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1311/2633] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:23:47 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:23:47.777776 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a44a8-20dd-47f3-bd9a-8d203d90fa27 service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:47.793258 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a44a8-20dd-47f3-bd9a-8d203d90fa27 service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:47.802687 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5318a-43bc-4ece-871e-7fcc8ee0811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:47.831940 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5318a-43bc-4ece-871e-7fcc8ee0811b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:47.832676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5318a-43bc-4ece-871e-7fcc8ee0811b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:47.834445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5318a-43bc-4ece-871e-7fcc8ee0811b admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:47.840837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5318a-43bc-4ece-871e-7fcc8ee0811b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:47.842976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5318a-43bc-4ece-871e-7fcc8ee0811b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:47.881398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1323/2634] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:47.884933 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247dad5-7f94-41b3-991c-1af9d99cd97e admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:47.911278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247dad5-7f94-41b3-991c-1af9d99cd97e admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:47.926577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541d5a6-efcd-44ad-9d04-f48e50bb1fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:47.928321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541d5a6-efcd-44ad-9d04-f48e50bb1fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:47.928772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541d5a6-efcd-44ad-9d04-f48e50bb1fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:47.929208 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541d5a6-efcd-44ad-9d04-f48e50bb1fdb admin admin] PATH_INFO: `/v3/projects/d1c429764a034c529535641e0c84204e/users/a71fd1176b864b358e166f2fbf2d4574/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:47.955486 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541d5a6-efcd-44ad-9d04-f48e50bb1fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c429764a034c529535641e0c84204e, user_id=a71fd1176b864b358e166f2fbf2d4574, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:47.958809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541d5a6-efcd-44ad-9d04-f48e50bb1fdb admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:47.986092 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1312/2635] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:47 2022] PUT /identity/v3/projects/d1c429764a034c529535641e0c84204e/users/a71fd1176b864b358e166f2fbf2d4574/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:47.989802 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5318a-43bc-4ece-871e-7fcc8ee0811b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:48.006116 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5318a-43bc-4ece-871e-7fcc8ee0811b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:48.091797 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c02a6-ea19-4a55-baff-ea28db20f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:48.092908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c02a6-ea19-4a55-baff-ea28db20f587 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:48.093349 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c02a6-ea19-4a55-baff-ea28db20f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:48.093764 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c02a6-ea19-4a55-baff-ea28db20f587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:48.095019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c02a6-ea19-4a55-baff-ea28db20f587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:48.096724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c02a6-ea19-4a55-baff-ea28db20f587 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:48.109226 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1324/2636] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:23:48.113364 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541d5a6-efcd-44ad-9d04-f48e50bb1fdb admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:48.124883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541d5a6-efcd-44ad-9d04-f48e50bb1fdb admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:48.131014 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af606d71-d3b5-4929-a334-cc179ae1963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:48.132051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606d71-d3b5-4929-a334-cc179ae1963b admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:48.132327 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606d71-d3b5-4929-a334-cc179ae1963b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:48.132599 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606d71-d3b5-4929-a334-cc179ae1963b admin admin] PATH_INFO: `/v3/projects/d1c429764a034c529535641e0c84204e/users/a71fd1176b864b358e166f2fbf2d4574/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:48.134803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af606d71-d3b5-4929-a334-cc179ae1963b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c429764a034c529535641e0c84204e, user_id=a71fd1176b864b358e166f2fbf2d4574, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:48.137701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af606d71-d3b5-4929-a334-cc179ae1963b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:48.150349 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1313/2637] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:23:48 2022] PUT /identity/v3/projects/d1c429764a034c529535641e0c84204e/users/a71fd1176b864b358e166f2fbf2d4574/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:48.166173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a4573-25f3-4335-ba7c-68ebccb7542d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:48.166536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a4573-25f3-4335-ba7c-68ebccb7542d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:48.166807 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a4573-25f3-4335-ba7c-68ebccb7542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:48.184592 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:48.208664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-755a4573-25f3-4335-ba7c-68ebccb7542d None None] MFA Rules not processed for user `a71fd1176b864b358e166f2fbf2d4574`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:48.209918 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-755a4573-25f3-4335-ba7c-68ebccb7542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:48.311261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1325/2638] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:48.325711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af606d71-d3b5-4929-a334-cc179ae1963b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:48.327482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-af606d71-d3b5-4929-a334-cc179ae1963b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:48.408009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af606d71-d3b5-4929-a334-cc179ae1963b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:48.415220 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e8f07-c5c3-48d2-a443-c7029c922099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:48.415924 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8f07-c5c3-48d2-a443-c7029c922099 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:48.416202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8f07-c5c3-48d2-a443-c7029c922099 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:48.416473 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8f07-c5c3-48d2-a443-c7029c922099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:48.489902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e8f07-c5c3-48d2-a443-c7029c922099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:48.491791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e8f07-c5c3-48d2-a443-c7029c922099 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:48.497267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:48.510235 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1314/2639] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:50.181207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c59868-38f8-4853-a430-510d8402f1b1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:50.182121 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c59868-38f8-4853-a430-510d8402f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:50.182576 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c59868-38f8-4853-a430-510d8402f1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:50.205691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b5c59868-38f8-4853-a430-510d8402f1b1 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:50.221739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b5c59868-38f8-4853-a430-510d8402f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:50.311177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1326/2640] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 28 03:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:50.339422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e8f07-c5c3-48d2-a443-c7029c922099 service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:50.541263 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e8f07-c5c3-48d2-a443-c7029c922099 service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:50.551004 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9805d7b-9bb2-4fb8-84b2-4683b2f47a31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:50.552265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9805d7b-9bb2-4fb8-84b2-4683b2f47a31 service nova] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:50.552657 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9805d7b-9bb2-4fb8-84b2-4683b2f47a31 service nova] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:50.553769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9805d7b-9bb2-4fb8-84b2-4683b2f47a31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:50.590255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9805d7b-9bb2-4fb8-84b2-4683b2f47a31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:50.590255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9805d7b-9bb2-4fb8-84b2-4683b2f47a31 service nova] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:50.620495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1315/2641] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:53.111221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c59868-38f8-4853-a430-510d8402f1b1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:53.112882 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b5c59868-38f8-4853-a430-510d8402f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:53.132131 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c59868-38f8-4853-a430-510d8402f1b1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:53.135923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15423c-c04e-4971-ba60-5a86bace2fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:53.136621 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15423c-c04e-4971-ba60-5a86bace2fcc service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:53.136900 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15423c-c04e-4971-ba60-5a86bace2fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:53.137170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15423c-c04e-4971-ba60-5a86bace2fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:53.148328 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15423c-c04e-4971-ba60-5a86bace2fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:53.149789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15423c-c04e-4971-ba60-5a86bace2fcc service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:53.161241 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1327/2642] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:54.392466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229159-0593-450d-9f2a-d74be178ee43 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:54.392997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229159-0593-450d-9f2a-d74be178ee43 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:54.392997 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229159-0593-450d-9f2a-d74be178ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:54.413628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-85229159-0593-450d-9f2a-d74be178ee43 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:54.414903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-85229159-0593-450d-9f2a-d74be178ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:54.424730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1316/2643] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 28 03:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:54.448231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15423c-c04e-4971-ba60-5a86bace2fcc service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:54.463658 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15423c-c04e-4971-ba60-5a86bace2fcc service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:54.470891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11378dd3-95b7-49e8-a026-384fb6662742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:54.471559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11378dd3-95b7-49e8-a026-384fb6662742 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:54.471840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11378dd3-95b7-49e8-a026-384fb6662742 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:54.472103 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11378dd3-95b7-49e8-a026-384fb6662742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:54.482779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11378dd3-95b7-49e8-a026-384fb6662742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:54.484375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11378dd3-95b7-49e8-a026-384fb6662742 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:54.495061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1328/2644] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:55.539139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85229159-0593-450d-9f2a-d74be178ee43 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:55.540788 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-85229159-0593-450d-9f2a-d74be178ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:55.605599 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85229159-0593-450d-9f2a-d74be178ee43 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:55.609974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a9b6d-5e83-4b9b-8db7-5b69bdf19591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:55.610760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9b6d-5e83-4b9b-8db7-5b69bdf19591 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:55.611089 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9b6d-5e83-4b9b-8db7-5b69bdf19591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:55.611365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9b6d-5e83-4b9b-8db7-5b69bdf19591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:55.613583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-862a9b6d-5e83-4b9b-8db7-5b69bdf19591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:55.681548 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a9b6d-5e83-4b9b-8db7-5b69bdf19591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:55.683044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a9b6d-5e83-4b9b-8db7-5b69bdf19591 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:55.692886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1317/2645] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:58.223186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11378dd3-95b7-49e8-a026-384fb6662742 service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:58.237578 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11378dd3-95b7-49e8-a026-384fb6662742 service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:58.245003 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:58.245974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:58.246259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:58.246558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] PATH_INFO: `/v3/users/d6836d4eb196404f84669b4df02b757d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:58.247824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6836d4eb196404f84669b4df02b757d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:58.249949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:58.312138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6836d4eb196404f84669b4df02b757d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:58.313242 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6836d4eb196404f84669b4df02b757d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:58.323660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6836d4eb196404f84669b4df02b757d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:58.329966 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:58.338130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6836d4eb196404f84669b4df02b757d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:58.345921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6836d4eb196404f84669b4df02b757d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:58.352541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1329/2646] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:58 2022] DELETE /identity/v3/users/d6836d4eb196404f84669b4df02b757d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:58.357218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073338-a25a-4104-b3db-c45bea10fb6a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:58.357718 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073338-a25a-4104-b3db-c45bea10fb6a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:58.357814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073338-a25a-4104-b3db-c45bea10fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:58.376315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-75073338-a25a-4104-b3db-c45bea10fb6a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:58.377525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-75073338-a25a-4104-b3db-c45bea10fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:58.407901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:58.440877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1318/2647] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:23:58.451066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:58.452622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:58.518171 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2c0a4-857e-479e-8c80-56ac7c04ae8e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:58.527978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf39fd-6d1e-4d95-9f9f-62550a63106f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:58.528668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf39fd-6d1e-4d95-9f9f-62550a63106f service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:58.528957 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf39fd-6d1e-4d95-9f9f-62550a63106f service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:58.529321 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf39fd-6d1e-4d95-9f9f-62550a63106f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:58.542584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf39fd-6d1e-4d95-9f9f-62550a63106f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:58.544427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf39fd-6d1e-4d95-9f9f-62550a63106f service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:58.558766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1330/2648] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:23:58.588878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17ea47-d402-4351-8a5d-876456d21169 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:58.589166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17ea47-d402-4351-8a5d-876456d21169 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:58.589434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17ea47-d402-4351-8a5d-876456d21169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:58.619570 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8f17ea47-d402-4351-8a5d-876456d21169 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:23:58.620816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8f17ea47-d402-4351-8a5d-876456d21169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:58.630706 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1319/2649] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 28 03:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:23:58.655098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf39fd-6d1e-4d95-9f9f-62550a63106f service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:58.656590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0acf39fd-6d1e-4d95-9f9f-62550a63106f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:58.788301 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf39fd-6d1e-4d95-9f9f-62550a63106f service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:58.794462 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4717c4b-b0fc-4146-80ec-692834c4aba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:58.795233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4717c4b-b0fc-4146-80ec-692834c4aba0 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:58.795586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4717c4b-b0fc-4146-80ec-692834c4aba0 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:58.795929 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4717c4b-b0fc-4146-80ec-692834c4aba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:58.810765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4717c4b-b0fc-4146-80ec-692834c4aba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:58.813136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4717c4b-b0fc-4146-80ec-692834c4aba0 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:58.834860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1331/2650] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:23:58.912182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17ea47-d402-4351-8a5d-876456d21169 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:58.913871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8f17ea47-d402-4351-8a5d-876456d21169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:58.934034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17ea47-d402-4351-8a5d-876456d21169 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:58.939250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:58.940207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:58.940489 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:58.940759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] PATH_INFO: `/v3/projects/360a47a4fbe74da7b542492f91779b1b` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:58.942883 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=360a47a4fbe74da7b542492f91779b1b)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:58.944835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:59.062544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '360a47a4fbe74da7b542492f91779b1b', 'request_id': 'req-115b8b9c-c9f6-448f-9c35-cd24c5f25108'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:59.069555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '360a47a4fbe74da7b542492f91779b1b', 'request_id': 'req-115b8b9c-c9f6-448f-9c35-cd24c5f25108'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:59.079659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '360a47a4fbe74da7b542492f91779b1b', 'request_id': 'req-115b8b9c-c9f6-448f-9c35-cd24c5f25108'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:59.092967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] The token cache is being invalidate because project 360a47a4fbe74da7b542492f91779b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:23:59.093727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:59.100868 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:59.102770 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1320/2651] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:58 2022] DELETE /identity/v3/projects/360a47a4fbe74da7b542492f91779b1b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:59.106873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4717c4b-b0fc-4146-80ec-692834c4aba0 service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:59.117316 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4717c4b-b0fc-4146-80ec-692834c4aba0 service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:59.177980 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195baec-e7a0-4452-91e5-f1370974dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:59.178901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195baec-e7a0-4452-91e5-f1370974dd22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:59.179180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195baec-e7a0-4452-91e5-f1370974dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:59.179453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195baec-e7a0-4452-91e5-f1370974dd22 admin admin] PATH_INFO: `/v3/users/a71fd1176b864b358e166f2fbf2d4574` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:59.180607 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195baec-e7a0-4452-91e5-f1370974dd22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71fd1176b864b358e166f2fbf2d4574)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:59.182598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195baec-e7a0-4452-91e5-f1370974dd22 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:23:59.188163 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:59.236063 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b195baec-e7a0-4452-91e5-f1370974dd22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71fd1176b864b358e166f2fbf2d4574'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:59.237272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b195baec-e7a0-4452-91e5-f1370974dd22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71fd1176b864b358e166f2fbf2d4574'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:59.246022 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b195baec-e7a0-4452-91e5-f1370974dd22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71fd1176b864b358e166f2fbf2d4574'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:59.263513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b195baec-e7a0-4452-91e5-f1370974dd22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71fd1176b864b358e166f2fbf2d4574'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:59.272385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b195baec-e7a0-4452-91e5-f1370974dd22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71fd1176b864b358e166f2fbf2d4574'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:23:59.278618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1332/2652] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:23:59 2022] DELETE /identity/v3/users/a71fd1176b864b358e166f2fbf2d4574 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:23:59.777198 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:23:59.784202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:23:59.798719 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b8b9c-c9f6-448f-9c35-cd24c5f25108 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:23:59.923790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:23:59.924748 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:23:59.925031 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:23:59.925385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] PATH_INFO: `/v3/projects/d1c429764a034c529535641e0c84204e` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:23:59.927668 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c429764a034c529535641e0c84204e)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:23:59.930851 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:00.016068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c429764a034c529535641e0c84204e', 'request_id': 'req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:00.018380 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:00.023925 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c429764a034c529535641e0c84204e', 'request_id': 'req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:00.033575 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c429764a034c529535641e0c84204e', 'request_id': 'req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:00.048365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] The token cache is being invalidate because project d1c429764a034c529535641e0c84204e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:24:00.048634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:00.049285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-9b4c0af1-9bfe-4dbb-a2fc-7819e25310db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:00.055636 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1321/2653] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:23:59 2022] DELETE /identity/v3/projects/d1c429764a034c529535641e0c84204e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:00.058140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e876a-a79c-4b4b-918c-7e10788374bc None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:00.058674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e876a-a79c-4b4b-918c-7e10788374bc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:00.058949 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e876a-a79c-4b4b-918c-7e10788374bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:00.080645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9a8e876a-a79c-4b4b-918c-7e10788374bc None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:00.083054 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9a8e876a-a79c-4b4b-918c-7e10788374bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:00.167156 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1333/2654] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:00.175729 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c78b1-2da3-498a-aec7-ecd4caffdef2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:00.176018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c78b1-2da3-498a-aec7-ecd4caffdef2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:00.176295 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c78b1-2da3-498a-aec7-ecd4caffdef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:00.197710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-1b5c78b1-2da3-498a-aec7-ecd4caffdef2 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:00.199090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1b5c78b1-2da3-498a-aec7-ecd4caffdef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:00.207234 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1322/2655] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:00.211600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e876a-a79c-4b4b-918c-7e10788374bc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:00.221981 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e876a-a79c-4b4b-918c-7e10788374bc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:00.226860 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215e0b-6cdb-4932-8ca5-24e89bdaa415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:00.227540 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215e0b-6cdb-4932-8ca5-24e89bdaa415 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:00.227815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215e0b-6cdb-4932-8ca5-24e89bdaa415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:00.228090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215e0b-6cdb-4932-8ca5-24e89bdaa415 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:00.228852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4215e0b-6cdb-4932-8ca5-24e89bdaa415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:24:00.229227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4215e0b-6cdb-4932-8ca5-24e89bdaa415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:00.230913 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4215e0b-6cdb-4932-8ca5-24e89bdaa415 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:00.244203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1334/2656] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:24:00.249030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c78b1-2da3-498a-aec7-ecd4caffdef2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:00.258877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c78b1-2da3-498a-aec7-ecd4caffdef2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:00.264409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8088e-35a6-4305-a363-eafad5337a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:00.265182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8088e-35a6-4305-a363-eafad5337a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:00.265583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8088e-35a6-4305-a363-eafad5337a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:00.265880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8088e-35a6-4305-a363-eafad5337a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:00.266649 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8088e-35a6-4305-a363-eafad5337a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:00.268674 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8088e-35a6-4305-a363-eafad5337a01 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:00.299438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1323/2657] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:24:00 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:24:00.304398 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215e0b-6cdb-4932-8ca5-24e89bdaa415 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:00.315009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215e0b-6cdb-4932-8ca5-24e89bdaa415 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:00.375679 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae33be-7046-41fd-aff1-e98e3706db9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:00.376300 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae33be-7046-41fd-aff1-e98e3706db9c admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:00.376583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae33be-7046-41fd-aff1-e98e3706db9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:00.376861 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae33be-7046-41fd-aff1-e98e3706db9c admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:00.377567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae33be-7046-41fd-aff1-e98e3706db9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:00.379836 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae33be-7046-41fd-aff1-e98e3706db9c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:00.400515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1335/2658] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:24:00 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:24:00.404586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8088e-35a6-4305-a363-eafad5337a01 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:00.416095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8088e-35a6-4305-a363-eafad5337a01 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:00.420959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c557b-2cf1-483f-ba29-e99c37053aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:00.421620 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c557b-2cf1-483f-ba29-e99c37053aad admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:00.421901 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c557b-2cf1-483f-ba29-e99c37053aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:00.422171 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c557b-2cf1-483f-ba29-e99c37053aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:00.422948 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c557b-2cf1-483f-ba29-e99c37053aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:00.424572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c557b-2cf1-483f-ba29-e99c37053aad admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:00.435835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1324/2659] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:24:00.443437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae33be-7046-41fd-aff1-e98e3706db9c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:00.449346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:00.457002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae33be-7046-41fd-aff1-e98e3706db9c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:00.463785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdef33d-7bf1-4d1b-898f-7a34c4693fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:00.464837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef33d-7bf1-4d1b-898f-7a34c4693fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:00.465218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef33d-7bf1-4d1b-898f-7a34c4693fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:00.465403 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef33d-7bf1-4d1b-898f-7a34c4693fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:00.466535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdef33d-7bf1-4d1b-898f-7a34c4693fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:00.468501 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdef33d-7bf1-4d1b-898f-7a34c4693fdd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:00.481124 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1336/2660] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:24:00.485431 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c557b-2cf1-483f-ba29-e99c37053aad admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:00.503593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c557b-2cf1-483f-ba29-e99c37053aad admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:00.510682 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0a277-5608-4102-8e7d-b6ed0e5776bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:00.512288 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0a277-5608-4102-8e7d-b6ed0e5776bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:00.512863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0a277-5608-4102-8e7d-b6ed0e5776bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:00.513355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0a277-5608-4102-8e7d-b6ed0e5776bb admin admin] PATH_INFO: `/v3/projects/faeb19ee78bb4e138bd656bcc75c343c/users/b97ea52a3d914532828ede8d93780131/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:00.533218 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0a277-5608-4102-8e7d-b6ed0e5776bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=faeb19ee78bb4e138bd656bcc75c343c, user_id=b97ea52a3d914532828ede8d93780131, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:00.536063 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0a277-5608-4102-8e7d-b6ed0e5776bb admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:00.551650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1325/2661] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:24:00 2022] PUT /identity/v3/projects/faeb19ee78bb4e138bd656bcc75c343c/users/b97ea52a3d914532828ede8d93780131/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:24:00.562962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b4192-8c87-4e5e-b683-e50615dfee99 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:00.563327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b4192-8c87-4e5e-b683-e50615dfee99 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:00.563609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b4192-8c87-4e5e-b683-e50615dfee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:00.594845 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5b6b4192-8c87-4e5e-b683-e50615dfee99 None None] MFA Rules not processed for user `b97ea52a3d914532828ede8d93780131`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:00.596630 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5b6b4192-8c87-4e5e-b683-e50615dfee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:00.679078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1337/2662] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:00.690645 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0a277-5608-4102-8e7d-b6ed0e5776bb admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:00.692411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bbb0a277-5608-4102-8e7d-b6ed0e5776bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:00.752024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0a277-5608-4102-8e7d-b6ed0e5776bb admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:00.756432 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766aa53-0e21-459a-8b46-3073b1a8bb9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:00.757091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766aa53-0e21-459a-8b46-3073b1a8bb9a service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:00.757375 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766aa53-0e21-459a-8b46-3073b1a8bb9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:00.757648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766aa53-0e21-459a-8b46-3073b1a8bb9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:00.767343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766aa53-0e21-459a-8b46-3073b1a8bb9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:00.769081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766aa53-0e21-459a-8b46-3073b1a8bb9a service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:00.781793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1326/2663] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:01.939290 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b4192-8c87-4e5e-b683-e50615dfee99 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:01.940872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5b6b4192-8c87-4e5e-b683-e50615dfee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:01.968808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093211c3-c74a-459a-9d4c-28d9b8531761 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:01.969445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093211c3-c74a-459a-9d4c-28d9b8531761 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:01.969445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093211c3-c74a-459a-9d4c-28d9b8531761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:01.987421 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-093211c3-c74a-459a-9d4c-28d9b8531761 None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:01.988716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-093211c3-c74a-459a-9d4c-28d9b8531761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:02.018338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b4192-8c87-4e5e-b683-e50615dfee99 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:02.022412 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed7802-8468-49e7-b344-075c160243f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:02.023081 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed7802-8468-49e7-b344-075c160243f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:02.023382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed7802-8468-49e7-b344-075c160243f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:02.023658 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed7802-8468-49e7-b344-075c160243f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:02.025756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-52ed7802-8468-49e7-b344-075c160243f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:02.048045 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1327/2664] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:24:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:02.066072 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093211c3-c74a-459a-9d4c-28d9b8531761 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:02.067727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-093211c3-c74a-459a-9d4c-28d9b8531761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:02.096529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:02.097557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed7802-8468-49e7-b344-075c160243f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:02.099095 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed7802-8468-49e7-b344-075c160243f1 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:02.111542 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1338/2665] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:02.151165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093211c3-c74a-459a-9d4c-28d9b8531761 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:02.157716 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49bc2b-4ca0-4e7f-86fc-c9c7c47b8b9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:02.158513 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49bc2b-4ca0-4e7f-86fc-c9c7c47b8b9f service swift] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:02.158867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49bc2b-4ca0-4e7f-86fc-c9c7c47b8b9f service swift] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:02.159212 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49bc2b-4ca0-4e7f-86fc-c9c7c47b8b9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:02.179181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49bc2b-4ca0-4e7f-86fc-c9c7c47b8b9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:02.180826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49bc2b-4ca0-4e7f-86fc-c9c7c47b8b9f service swift] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:02.189849 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1328/2666] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:24:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:06.639079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed7802-8468-49e7-b344-075c160243f1 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:06.640831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-52ed7802-8468-49e7-b344-075c160243f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:06.693292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:06.784194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed7802-8468-49e7-b344-075c160243f1 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:06.791522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a575c-ec0e-486e-9ef1-f1a201ebf5e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8048235c6421eae12ca99f80ed5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:06.792638 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a575c-ec0e-486e-9ef1-f1a201ebf5e9 service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:06.793198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a575c-ec0e-486e-9ef1-f1a201ebf5e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:06.793730 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a575c-ec0e-486e-9ef1-f1a201ebf5e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:06.795867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6e2a575c-ec0e-486e-9ef1-f1a201ebf5e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:06.816505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a575c-ec0e-486e-9ef1-f1a201ebf5e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:06.829998 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a575c-ec0e-486e-9ef1-f1a201ebf5e9 service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:06.859422 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1339/2667] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:11.808446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49bc2b-4ca0-4e7f-86fc-c9c7c47b8b9f service swift] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:11.808446 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-7e49bc2b-4ca0-4e7f-86fc-c9c7c47b8b9f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:11.855843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49bc2b-4ca0-4e7f-86fc-c9c7c47b8b9f service swift] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:11.869847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:11.871676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:11.872267 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:11.872647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] PATH_INFO: `/v3/users/11943b3f150a4a2ea29d3a772b93a7ae` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:11.874527 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=11943b3f150a4a2ea29d3a772b93a7ae)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:11.879793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:11.953466 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11943b3f150a4a2ea29d3a772b93a7ae'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:11.954550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11943b3f150a4a2ea29d3a772b93a7ae'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:11.985280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11943b3f150a4a2ea29d3a772b93a7ae'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.006003 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11943b3f150a4a2ea29d3a772b93a7ae'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.039604 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11943b3f150a4a2ea29d3a772b93a7ae'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.055414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1329/2668] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:24:11 2022] DELETE /identity/v3/users/11943b3f150a4a2ea29d3a772b93a7ae => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:24:12.260012 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a575c-ec0e-486e-9ef1-f1a201ebf5e9 service placement] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:12.271583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a575c-ec0e-486e-9ef1-f1a201ebf5e9 service placement] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:12.335952 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:12.336849 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:12.337128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:12.337397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] PATH_INFO: `/v3/projects/d95edf0b8e49458eb703627f8000e07e` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:12.338647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95edf0b8e49458eb703627f8000e07e)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:12.341010 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:12.397614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95edf0b8e49458eb703627f8000e07e', 'request_id': 'req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.407182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95edf0b8e49458eb703627f8000e07e', 'request_id': 'req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.416362 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95edf0b8e49458eb703627f8000e07e', 'request_id': 'req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.427970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] The token cache is being invalidate because project d95edf0b8e49458eb703627f8000e07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:24:12.428194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.428841 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.430613 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1340/2669] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:24:12 2022] DELETE /identity/v3/projects/d95edf0b8e49458eb703627f8000e07e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:12.434966 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:12.436415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:12.450337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd613450-cc68-4942-b9eb-515fc2e17bcd admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:12.512555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:12.513507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:12.513787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:12.514062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] PATH_INFO: `/v3/users/b4bfd7fbb9964920bdd5ceefc88f8609` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:12.515413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4bfd7fbb9964920bdd5ceefc88f8609)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:12.517359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:12.550173 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:12.568909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4bfd7fbb9964920bdd5ceefc88f8609'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.569572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4bfd7fbb9964920bdd5ceefc88f8609'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.576333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4bfd7fbb9964920bdd5ceefc88f8609'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.584882 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4bfd7fbb9964920bdd5ceefc88f8609'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.598157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4bfd7fbb9964920bdd5ceefc88f8609'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.604024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1330/2670] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:24:12 2022] DELETE /identity/v3/users/b4bfd7fbb9964920bdd5ceefc88f8609 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:24:12.795747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:12.799195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:12.821265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0c4f9-a1f6-4155-9024-a2d38ac8b7c0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:12.877291 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:12.888513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:12.889391 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:12.889674 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:12.889948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] PATH_INFO: `/v3/projects/fab994de2ca84c9b8b6c6e3d0496ed4f` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:12.891191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fab994de2ca84c9b8b6c6e3d0496ed4f)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:12.893110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:12.942658 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fab994de2ca84c9b8b6c6e3d0496ed4f', 'request_id': 'req-d3f51c6e-8c73-4376-8582-23561b5edcf9'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.949067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fab994de2ca84c9b8b6c6e3d0496ed4f', 'request_id': 'req-d3f51c6e-8c73-4376-8582-23561b5edcf9'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.958194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fab994de2ca84c9b8b6c6e3d0496ed4f', 'request_id': 'req-d3f51c6e-8c73-4376-8582-23561b5edcf9'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.969243 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] The token cache is being invalidate because project fab994de2ca84c9b8b6c6e3d0496ed4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:24:12.969522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.970152 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d3f51c6e-8c73-4376-8582-23561b5edcf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:12.971761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1341/2671] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:24:12 2022] DELETE /identity/v3/projects/fab994de2ca84c9b8b6c6e3d0496ed4f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:14.464167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:14.466095 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:14.479824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6b5b5-9cd4-497b-91b7-95f50b88f9f9 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:14.539592 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:14.540559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:14.540840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:14.541113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] PATH_INFO: `/v3/users/b97ea52a3d914532828ede8d93780131` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:14.542355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97ea52a3d914532828ede8d93780131)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:14.544339 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:14.592717 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97ea52a3d914532828ede8d93780131'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:14.593349 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97ea52a3d914532828ede8d93780131'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:14.600301 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97ea52a3d914532828ede8d93780131'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:14.609160 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97ea52a3d914532828ede8d93780131'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:14.621492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97ea52a3d914532828ede8d93780131'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:14.628181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1331/2672] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:24:14 2022] DELETE /identity/v3/users/b97ea52a3d914532828ede8d93780131 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:14.633016 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0d1f0-e21b-4cda-a385-7602e6c14974 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:14.633534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0d1f0-e21b-4cda-a385-7602e6c14974 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:14.633534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0d1f0-e21b-4cda-a385-7602e6c14974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:14.651844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-71b0d1f0-e21b-4cda-a385-7602e6c14974 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:14.652970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-71b0d1f0-e21b-4cda-a385-7602e6c14974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:14.713774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1342/2673] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:24:14.724735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:14.726312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:14.755071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:14.786601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0321d3-92f2-4c69-8547-78695b901a42 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:14.790631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19ffec-a671-4549-95be-0cbc38765e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:14.791279 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19ffec-a671-4549-95be-0cbc38765e8c service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:14.791555 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19ffec-a671-4549-95be-0cbc38765e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:14.791816 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19ffec-a671-4549-95be-0cbc38765e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:14.802069 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19ffec-a671-4549-95be-0cbc38765e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:14.803557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19ffec-a671-4549-95be-0cbc38765e8c service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:14.813053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1332/2674] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:14.942751 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0d1f0-e21b-4cda-a385-7602e6c14974 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:14.944669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-71b0d1f0-e21b-4cda-a385-7602e6c14974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:14.959490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0d1f0-e21b-4cda-a385-7602e6c14974 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:14.965220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:14.966496 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:14.966968 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:14.967202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] PATH_INFO: `/v3/users/37ec7a59220248bc8be66eaea6f345c2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:14.968631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ec7a59220248bc8be66eaea6f345c2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:14.970598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:15.024078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ec7a59220248bc8be66eaea6f345c2'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.024742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ec7a59220248bc8be66eaea6f345c2'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.032413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ec7a59220248bc8be66eaea6f345c2'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.045457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ec7a59220248bc8be66eaea6f345c2'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.050499 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:15.053670 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ec7a59220248bc8be66eaea6f345c2'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.060609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1343/2675] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:24:14 2022] DELETE /identity/v3/users/37ec7a59220248bc8be66eaea6f345c2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:15.065458 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943030c-d9d5-4868-a787-28e0dd03c37a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:15.065820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943030c-d9d5-4868-a787-28e0dd03c37a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:15.065820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943030c-d9d5-4868-a787-28e0dd03c37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:15.085326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e943030c-d9d5-4868-a787-28e0dd03c37a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:15.086751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e943030c-d9d5-4868-a787-28e0dd03c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:15.098315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:15.100571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:15.163583 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1333/2676] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:15.173053 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943030c-d9d5-4868-a787-28e0dd03c37a None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:15.174772 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e943030c-d9d5-4868-a787-28e0dd03c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:15.185365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6f0e2-703f-4f10-8427-37a5935bc6a8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:15.190051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:15.191011 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:15.191289 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:15.191561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] PATH_INFO: `/v3/projects/faeb19ee78bb4e138bd656bcc75c343c` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:15.192763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faeb19ee78bb4e138bd656bcc75c343c)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:15.194716 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:15.235497 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943030c-d9d5-4868-a787-28e0dd03c37a None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:15.240243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6da3d-4bfd-4ae1-951d-4890a974108e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:15.240906 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6da3d-4bfd-4ae1-951d-4890a974108e service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:15.241183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6da3d-4bfd-4ae1-951d-4890a974108e service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:15.241457 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6da3d-4bfd-4ae1-951d-4890a974108e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:15.252138 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6da3d-4bfd-4ae1-951d-4890a974108e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:15.253808 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6da3d-4bfd-4ae1-951d-4890a974108e service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:15.255177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faeb19ee78bb4e138bd656bcc75c343c', 'request_id': 'req-8b16368a-e247-4764-9496-c8babcb13885'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.261960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faeb19ee78bb4e138bd656bcc75c343c', 'request_id': 'req-8b16368a-e247-4764-9496-c8babcb13885'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.264304 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1334/2677] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:15.277252 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faeb19ee78bb4e138bd656bcc75c343c', 'request_id': 'req-8b16368a-e247-4764-9496-c8babcb13885'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.291754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] The token cache is being invalidate because project faeb19ee78bb4e138bd656bcc75c343c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:24:15.292034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.292837 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b16368a-e247-4764-9496-c8babcb13885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.294869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1344/2678] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:24:15 2022] DELETE /identity/v3/projects/faeb19ee78bb4e138bd656bcc75c343c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:24:15.580894 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6da3d-4bfd-4ae1-951d-4890a974108e service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:15.583619 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6fe6da3d-4bfd-4ae1-951d-4890a974108e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:15.600019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6da3d-4bfd-4ae1-951d-4890a974108e service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:15.662533 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:15.663564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:15.663845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:15.664111 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] PATH_INFO: `/v3/projects/b31afea845124db8a607bef4037fe041` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:15.665308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31afea845124db8a607bef4037fe041)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:15.667322 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:15.679535 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:15.716903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31afea845124db8a607bef4037fe041', 'request_id': 'req-534e8403-059f-4549-972d-96a8ce6a02b2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.723809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31afea845124db8a607bef4037fe041', 'request_id': 'req-534e8403-059f-4549-972d-96a8ce6a02b2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.731824 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31afea845124db8a607bef4037fe041', 'request_id': 'req-534e8403-059f-4549-972d-96a8ce6a02b2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.744251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] The token cache is being invalidate because project b31afea845124db8a607bef4037fe041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:24:15.744512 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.745286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-534e8403-059f-4549-972d-96a8ce6a02b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:15.746976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1335/2679] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:24:15 2022] DELETE /identity/v3/projects/b31afea845124db8a607bef4037fe041 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:15.751827 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308a8b-8294-4e71-9597-44abd93de843 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:15.752320 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308a8b-8294-4e71-9597-44abd93de843 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:15.752428 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308a8b-8294-4e71-9597-44abd93de843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:15.771009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c7308a8b-8294-4e71-9597-44abd93de843 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:15.772203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c7308a8b-8294-4e71-9597-44abd93de843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:15.830943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1345/2680] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:15.842504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52216a1-80ac-4851-960a-ae4eb630b0f2 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:15.842789 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52216a1-80ac-4851-960a-ae4eb630b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:15.843065 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52216a1-80ac-4851-960a-ae4eb630b0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:15.865427 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-b52216a1-80ac-4851-960a-ae4eb630b0f2 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:15.867585 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b52216a1-80ac-4851-960a-ae4eb630b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:15.879531 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1336/2681] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:15.885728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7308a8b-8294-4e71-9597-44abd93de843 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:15.896761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7308a8b-8294-4e71-9597-44abd93de843 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:15.902340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910364b5-ffe8-438d-a0d4-c3fa0a73406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:15.903035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910364b5-ffe8-438d-a0d4-c3fa0a73406f admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:15.903309 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910364b5-ffe8-438d-a0d4-c3fa0a73406f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:15.903602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910364b5-ffe8-438d-a0d4-c3fa0a73406f admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:15.904322 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910364b5-ffe8-438d-a0d4-c3fa0a73406f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:24:15.904614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910364b5-ffe8-438d-a0d4-c3fa0a73406f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:15.906317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910364b5-ffe8-438d-a0d4-c3fa0a73406f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:15.924026 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1346/2682] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:24:15.925782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52216a1-80ac-4851-960a-ae4eb630b0f2 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:15.935545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52216a1-80ac-4851-960a-ae4eb630b0f2 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:15.940607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038d461-5e23-433e-b756-65281099e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:15.941485 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038d461-5e23-433e-b756-65281099e844 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:15.941766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038d461-5e23-433e-b756-65281099e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:15.942034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038d461-5e23-433e-b756-65281099e844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:15.942770 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038d461-5e23-433e-b756-65281099e844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:15.944653 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038d461-5e23-433e-b756-65281099e844 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:15.974804 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1337/2683] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:24:15 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:24:15.975881 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910364b5-ffe8-438d-a0d4-c3fa0a73406f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:15.986760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910364b5-ffe8-438d-a0d4-c3fa0a73406f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:15.995943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:16.049778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8aec-5b86-4c03-b9f1-8d8804223e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:16.051556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8aec-5b86-4c03-b9f1-8d8804223e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:16.051869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8aec-5b86-4c03-b9f1-8d8804223e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:16.052139 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8aec-5b86-4c03-b9f1-8d8804223e72 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:16.052867 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad8aec-5b86-4c03-b9f1-8d8804223e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:16.054801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad8aec-5b86-4c03-b9f1-8d8804223e72 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:16.081142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1347/2684] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:24:15 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:24:16.082514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038d461-5e23-433e-b756-65281099e844 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:16.094410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038d461-5e23-433e-b756-65281099e844 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:16.099565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc750c-3ac8-4473-9eaf-982c6d24ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:16.100251 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc750c-3ac8-4473-9eaf-982c6d24ec62 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:16.100539 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc750c-3ac8-4473-9eaf-982c6d24ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:16.100813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc750c-3ac8-4473-9eaf-982c6d24ec62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:16.101546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc750c-3ac8-4473-9eaf-982c6d24ec62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:16.103194 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc750c-3ac8-4473-9eaf-982c6d24ec62 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:16.114219 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1338/2685] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:24:16.118360 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8aec-5b86-4c03-b9f1-8d8804223e72 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:16.128982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8aec-5b86-4c03-b9f1-8d8804223e72 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:16.134239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb213d-a364-4ae8-98f7-10cdf522acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:16.135008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb213d-a364-4ae8-98f7-10cdf522acfe admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:16.135350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb213d-a364-4ae8-98f7-10cdf522acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:16.135629 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb213d-a364-4ae8-98f7-10cdf522acfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:16.136353 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb213d-a364-4ae8-98f7-10cdf522acfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:16.137991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb213d-a364-4ae8-98f7-10cdf522acfe admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:16.148537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1348/2686] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:24:16.152873 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc750c-3ac8-4473-9eaf-982c6d24ec62 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:16.163741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc750c-3ac8-4473-9eaf-982c6d24ec62 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:16.168817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d28e-3fbb-481d-bea8-df5093b78d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:16.169741 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d28e-3fbb-481d-bea8-df5093b78d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:16.170051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d28e-3fbb-481d-bea8-df5093b78d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:16.170366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d28e-3fbb-481d-bea8-df5093b78d23 admin admin] PATH_INFO: `/v3/projects/34fe087d876e4cab92dcd547f1d964fd/users/587c6704613541dfb88a90f9c9a4055b/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:16.185266 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02d28e-3fbb-481d-bea8-df5093b78d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fe087d876e4cab92dcd547f1d964fd, user_id=587c6704613541dfb88a90f9c9a4055b, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:16.188008 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02d28e-3fbb-481d-bea8-df5093b78d23 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:16.205068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1339/2687] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:24:16 2022] PUT /identity/v3/projects/34fe087d876e4cab92dcd547f1d964fd/users/587c6704613541dfb88a90f9c9a4055b/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:24:16.217014 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa301926-ab77-472c-979e-072a75e9c709 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:16.217297 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa301926-ab77-472c-979e-072a75e9c709 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:16.217601 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa301926-ab77-472c-979e-072a75e9c709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:16.254128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fa301926-ab77-472c-979e-072a75e9c709 None None] MFA Rules not processed for user `587c6704613541dfb88a90f9c9a4055b`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:16.255298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fa301926-ab77-472c-979e-072a75e9c709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:16.329536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1349/2688] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:16.344783 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d28e-3fbb-481d-bea8-df5093b78d23 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:16.347296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3c02d28e-3fbb-481d-bea8-df5093b78d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:16.408190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d28e-3fbb-481d-bea8-df5093b78d23 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:16.412751 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0651d81-7d11-44f8-903c-426df5051cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:16.413402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0651d81-7d11-44f8-903c-426df5051cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:16.413678 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0651d81-7d11-44f8-903c-426df5051cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:16.413922 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0651d81-7d11-44f8-903c-426df5051cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:16.423820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0651d81-7d11-44f8-903c-426df5051cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:16.426223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0651d81-7d11-44f8-903c-426df5051cb6 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:16.436012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1340/2689] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:19.028790 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa301926-ab77-472c-979e-072a75e9c709 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:19.098136 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa301926-ab77-472c-979e-072a75e9c709 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:19.102681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:19.103568 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:19.103842 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:19.104110 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] PATH_INFO: `/v3/users/587c6704613541dfb88a90f9c9a4055b` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:19.105287 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=587c6704613541dfb88a90f9c9a4055b)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:19.107239 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:19.130386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:19.165989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587c6704613541dfb88a90f9c9a4055b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:19.166711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587c6704613541dfb88a90f9c9a4055b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:19.178222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587c6704613541dfb88a90f9c9a4055b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:19.202259 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587c6704613541dfb88a90f9c9a4055b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:19.213943 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587c6704613541dfb88a90f9c9a4055b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:19.223249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1350/2690] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:24:19 2022] DELETE /identity/v3/users/587c6704613541dfb88a90f9c9a4055b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:19.228102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d41016-ec73-442d-8c5c-5eeaf62e40fa None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:19.228618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d41016-ec73-442d-8c5c-5eeaf62e40fa None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:19.229228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d41016-ec73-442d-8c5c-5eeaf62e40fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:19.249016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-78d41016-ec73-442d-8c5c-5eeaf62e40fa None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:19.250534 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-78d41016-ec73-442d-8c5c-5eeaf62e40fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:19.295336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:19.336754 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1341/2691] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:19.347413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:19.349292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:19.411327 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70652c-7451-4d15-91e7-9270f660d47a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:19.415180 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942ae4d-271b-4937-b0e1-a351f92ff3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:19.415835 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942ae4d-271b-4937-b0e1-a351f92ff3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:19.416112 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942ae4d-271b-4937-b0e1-a351f92ff3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:19.416381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942ae4d-271b-4937-b0e1-a351f92ff3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:19.427000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942ae4d-271b-4937-b0e1-a351f92ff3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:19.428448 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942ae4d-271b-4937-b0e1-a351f92ff3d8 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:19.438854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1351/2692] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:19.720988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d41016-ec73-442d-8c5c-5eeaf62e40fa None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:19.723601 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-78d41016-ec73-442d-8c5c-5eeaf62e40fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:19.749843 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d41016-ec73-442d-8c5c-5eeaf62e40fa None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:19.765094 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:19.765995 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:19.766277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:19.766574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] PATH_INFO: `/v3/projects/34fe087d876e4cab92dcd547f1d964fd` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:19.767924 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=34fe087d876e4cab92dcd547f1d964fd)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:19.770348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:19.822415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34fe087d876e4cab92dcd547f1d964fd', 'request_id': 'req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:19.829465 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34fe087d876e4cab92dcd547f1d964fd', 'request_id': 'req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:19.839302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34fe087d876e4cab92dcd547f1d964fd', 'request_id': 'req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:19.854034 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] The token cache is being invalidate because project 34fe087d876e4cab92dcd547f1d964fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:24:19.854394 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:19.855024 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-d4d3bca7-8fc8-45c0-8975-5dad97140f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:19.856634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1342/2693] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:24:19 2022] DELETE /identity/v3/projects/34fe087d876e4cab92dcd547f1d964fd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:19.861528 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520879db-c6b4-4c4f-9119-d52dac8002f5 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:19.861840 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520879db-c6b4-4c4f-9119-d52dac8002f5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:19.862116 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520879db-c6b4-4c4f-9119-d52dac8002f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:19.881971 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-520879db-c6b4-4c4f-9119-d52dac8002f5 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:19.883198 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-520879db-c6b4-4c4f-9119-d52dac8002f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:19.944165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1352/2694] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:19.952102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626e7f6-221d-493d-9ca0-a7c070e51a31 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:19.952388 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626e7f6-221d-493d-9ca0-a7c070e51a31 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:19.952660 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626e7f6-221d-493d-9ca0-a7c070e51a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:19.973800 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f626e7f6-221d-493d-9ca0-a7c070e51a31 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:19.975242 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f626e7f6-221d-493d-9ca0-a7c070e51a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:19.983495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1343/2695] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:19.988433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520879db-c6b4-4c4f-9119-d52dac8002f5 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:20.004532 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520879db-c6b4-4c4f-9119-d52dac8002f5 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:20.010539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd7fa1-7d4c-4f87-ae27-693b3dacc88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:20.011234 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd7fa1-7d4c-4f87-ae27-693b3dacc88d admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:20.011643 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd7fa1-7d4c-4f87-ae27-693b3dacc88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:20.011922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd7fa1-7d4c-4f87-ae27-693b3dacc88d admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:20.012711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd7fa1-7d4c-4f87-ae27-693b3dacc88d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:24:20.013161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd7fa1-7d4c-4f87-ae27-693b3dacc88d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:20.014820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd7fa1-7d4c-4f87-ae27-693b3dacc88d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:20.028479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1353/2696] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:24:20.032743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626e7f6-221d-493d-9ca0-a7c070e51a31 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:20.043303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626e7f6-221d-493d-9ca0-a7c070e51a31 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:20.048091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b936e6-dc2e-4c85-8942-97b01155e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:20.048765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b936e6-dc2e-4c85-8942-97b01155e5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:20.049040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b936e6-dc2e-4c85-8942-97b01155e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:20.049308 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b936e6-dc2e-4c85-8942-97b01155e5e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:20.050009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b936e6-dc2e-4c85-8942-97b01155e5e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:20.052752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b936e6-dc2e-4c85-8942-97b01155e5e9 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:20.082918 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1344/2697] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:24:20 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:24:20.087197 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd7fa1-7d4c-4f87-ae27-693b3dacc88d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:20.098315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd7fa1-7d4c-4f87-ae27-693b3dacc88d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:20.124490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:20.158479 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef361-3111-4956-82a6-cefdbfce81ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:20.159159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef361-3111-4956-82a6-cefdbfce81ff admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:20.159440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef361-3111-4956-82a6-cefdbfce81ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:20.159785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef361-3111-4956-82a6-cefdbfce81ff admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:20.160586 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ef361-3111-4956-82a6-cefdbfce81ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:20.162551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ef361-3111-4956-82a6-cefdbfce81ff admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:20.184225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1354/2698] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:24:20 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:24:20.188540 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b936e6-dc2e-4c85-8942-97b01155e5e9 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:20.199212 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b936e6-dc2e-4c85-8942-97b01155e5e9 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:20.204889 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e36f-b933-46bd-86bd-30e9a2660a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:20.205556 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e36f-b933-46bd-86bd-30e9a2660a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:20.205835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e36f-b933-46bd-86bd-30e9a2660a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:20.206102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e36f-b933-46bd-86bd-30e9a2660a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:20.206944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4e36f-b933-46bd-86bd-30e9a2660a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:20.208546 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4e36f-b933-46bd-86bd-30e9a2660a9c admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:20.219803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1345/2699] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:24:20.224099 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef361-3111-4956-82a6-cefdbfce81ff admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:20.235285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef361-3111-4956-82a6-cefdbfce81ff admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:20.240547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e74daf-7675-4523-8975-566087477aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:20.241203 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e74daf-7675-4523-8975-566087477aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:20.241482 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e74daf-7675-4523-8975-566087477aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:20.241752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e74daf-7675-4523-8975-566087477aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:20.242575 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e74daf-7675-4523-8975-566087477aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:20.244196 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e74daf-7675-4523-8975-566087477aeb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:20.254177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1355/2700] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:24:20.258603 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e36f-b933-46bd-86bd-30e9a2660a9c admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:20.269456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e36f-b933-46bd-86bd-30e9a2660a9c admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:20.274143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be1f34-b537-4e57-b191-c93e52a610bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:20.275066 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1f34-b537-4e57-b191-c93e52a610bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:20.275349 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1f34-b537-4e57-b191-c93e52a610bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:20.275617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1f34-b537-4e57-b191-c93e52a610bd admin admin] PATH_INFO: `/v3/projects/e454a67508794c189e3f0a750d0797a9/users/d36844f594444761bb01168ebfe7c816/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:20.292826 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be1f34-b537-4e57-b191-c93e52a610bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e454a67508794c189e3f0a750d0797a9, user_id=d36844f594444761bb01168ebfe7c816, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:20.295537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be1f34-b537-4e57-b191-c93e52a610bd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:20.310588 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1346/2701] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:24:20 2022] PUT /identity/v3/projects/e454a67508794c189e3f0a750d0797a9/users/d36844f594444761bb01168ebfe7c816/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:20.321488 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eb6e2-5f58-49e3-9faa-d9c1e62d9cb3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:20.321800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eb6e2-5f58-49e3-9faa-d9c1e62d9cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:20.322079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eb6e2-5f58-49e3-9faa-d9c1e62d9cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:20.353697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-738eb6e2-5f58-49e3-9faa-d9c1e62d9cb3 None None] MFA Rules not processed for user `d36844f594444761bb01168ebfe7c816`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:20.354970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-738eb6e2-5f58-49e3-9faa-d9c1e62d9cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:20.380846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f6774-b91c-42b7-bd73-3f8cd18d6db6 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:20.381311 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f6774-b91c-42b7-bd73-3f8cd18d6db6 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:20.381659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f6774-b91c-42b7-bd73-3f8cd18d6db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:20.402449 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-919f6774-b91c-42b7-bd73-3f8cd18d6db6 None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:20.404022 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-919f6774-b91c-42b7-bd73-3f8cd18d6db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:20.444691 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1356/2702] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:20.456047 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eb6e2-5f58-49e3-9faa-d9c1e62d9cb3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:20.458647 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-738eb6e2-5f58-49e3-9faa-d9c1e62d9cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:20.481557 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1347/2703] 10.222.0.23 () {58 vars in 967 bytes} [Tue Jun 28 03:24:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:20.494968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f6774-b91c-42b7-bd73-3f8cd18d6db6 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:20.496563 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-919f6774-b91c-42b7-bd73-3f8cd18d6db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:20.502654 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:20.531070 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eb6e2-5f58-49e3-9faa-d9c1e62d9cb3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:20.535038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ba158-dbb9-4f99-874a-7d10d0b6afcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:20.535700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ba158-dbb9-4f99-874a-7d10d0b6afcd service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:20.535982 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ba158-dbb9-4f99-874a-7d10d0b6afcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:20.536253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ba158-dbb9-4f99-874a-7d10d0b6afcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:20.545048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ba158-dbb9-4f99-874a-7d10d0b6afcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:20.546520 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ba158-dbb9-4f99-874a-7d10d0b6afcd service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:20.556019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1357/2704] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:24:20.576803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f6774-b91c-42b7-bd73-3f8cd18d6db6 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:20.582670 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed260e6-73ed-415e-8773-a95ed0bb9f28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:20.583330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed260e6-73ed-415e-8773-a95ed0bb9f28 service swift] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:20.583617 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed260e6-73ed-415e-8773-a95ed0bb9f28 service swift] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:20.583886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed260e6-73ed-415e-8773-a95ed0bb9f28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:20.592398 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed260e6-73ed-415e-8773-a95ed0bb9f28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:20.593949 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed260e6-73ed-415e-8773-a95ed0bb9f28 service swift] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:20.602488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1348/2705] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:24:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 28 03:24:22.000820 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d123090-f11b-4c53-85ee-e2087277afed None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:22.001409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d123090-f11b-4c53-85ee-e2087277afed None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:22.001409 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d123090-f11b-4c53-85ee-e2087277afed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:22.021686 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5d123090-f11b-4c53-85ee-e2087277afed None None] MFA Rules not processed for user `d36844f594444761bb01168ebfe7c816`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:22.022992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5d123090-f11b-4c53-85ee-e2087277afed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:22.032115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1358/2706] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:24.853420 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3446c6-17f7-48ab-92dd-c3ec366b94fc None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:24.854428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3446c6-17f7-48ab-92dd-c3ec366b94fc None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:24.854600 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3446c6-17f7-48ab-92dd-c3ec366b94fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:24.883502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-af3446c6-17f7-48ab-92dd-c3ec366b94fc None None] MFA Rules not processed for user `8f3f0264d71f49ff98d477bdfacf530d`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:24.884744 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-af3446c6-17f7-48ab-92dd-c3ec366b94fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:24.942245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1349/2707] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:25.193123 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d123090-f11b-4c53-85ee-e2087277afed None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:25.195017 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5d123090-f11b-4c53-85ee-e2087277afed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:25.236035 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:25.263794 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d123090-f11b-4c53-85ee-e2087277afed None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:25.267574 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f5379-6d76-4bf0-a70e-bb5090eeef7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:25.268315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f5379-6d76-4bf0-a70e-bb5090eeef7b service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:25.268892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f5379-6d76-4bf0-a70e-bb5090eeef7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:25.269423 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f5379-6d76-4bf0-a70e-bb5090eeef7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:25.271823 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f52f5379-6d76-4bf0-a70e-bb5090eeef7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:25.283371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f5379-6d76-4bf0-a70e-bb5090eeef7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:25.285138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f5379-6d76-4bf0-a70e-bb5090eeef7b service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:25.296133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1359/2708] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:34.935553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=55 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:35.291927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=11 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:37.013062 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920534c-1793-4e2d-b226-40171e28c57d None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:37.013561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920534c-1793-4e2d-b226-40171e28c57d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:37.013561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920534c-1793-4e2d-b226-40171e28c57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:37.033975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e920534c-1793-4e2d-b226-40171e28c57d None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:37.035209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e920534c-1793-4e2d-b226-40171e28c57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:37.047807 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1350/2709] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:24:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:37.057526 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f5379-6d76-4bf0-a70e-bb5090eeef7b service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:37.074220 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f5379-6d76-4bf0-a70e-bb5090eeef7b service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:37.080127 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ab7d-2558-4623-a285-03cdd809e8d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:37.080782 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ab7d-2558-4623-a285-03cdd809e8d4 service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:37.081061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ab7d-2558-4623-a285-03cdd809e8d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:37.081332 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ab7d-2558-4623-a285-03cdd809e8d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:37.092292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253ab7d-2558-4623-a285-03cdd809e8d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:37.094846 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253ab7d-2558-4623-a285-03cdd809e8d4 service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:37.105162 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1360/2710] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:24:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:37.683021 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827993e-67c4-4e2c-a07a-0bc62ee8d0af None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:37.683306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827993e-67c4-4e2c-a07a-0bc62ee8d0af None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:37.683578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827993e-67c4-4e2c-a07a-0bc62ee8d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:37.701890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e827993e-67c4-4e2c-a07a-0bc62ee8d0af None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:37.703119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e827993e-67c4-4e2c-a07a-0bc62ee8d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:37.711207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1351/2711] 10.222.0.23 () {58 vars in 967 bytes} [Tue Jun 28 03:24:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:37.727060 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ab7d-2558-4623-a285-03cdd809e8d4 service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:37.737701 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ab7d-2558-4623-a285-03cdd809e8d4 service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:37.742847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbba937-561d-4745-a5a3-a524ea7ff0b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:37.743478 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbba937-561d-4745-a5a3-a524ea7ff0b4 service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:37.743756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbba937-561d-4745-a5a3-a524ea7ff0b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:37.744023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbba937-561d-4745-a5a3-a524ea7ff0b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:37.751903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbba937-561d-4745-a5a3-a524ea7ff0b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:37.753496 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbba937-561d-4745-a5a3-a524ea7ff0b4 service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:37.761547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1361/2712] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:24:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:37.968574 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431cd6-044a-4180-a740-710b86adc3d4 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:37.968865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431cd6-044a-4180-a740-710b86adc3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:37.969245 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431cd6-044a-4180-a740-710b86adc3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:37.991912 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-e3431cd6-044a-4180-a740-710b86adc3d4 None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:37.993161 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-e3431cd6-044a-4180-a740-710b86adc3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:38.001511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1352/2713] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:24:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:38.013779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbba937-561d-4745-a5a3-a524ea7ff0b4 service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:38.025189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbba937-561d-4745-a5a3-a524ea7ff0b4 service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:38.031576 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d5ce2-8098-4386-b050-51a6a2fca27e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:38.032222 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5ce2-8098-4386-b050-51a6a2fca27e service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:38.032505 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5ce2-8098-4386-b050-51a6a2fca27e service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:38.032777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5ce2-8098-4386-b050-51a6a2fca27e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:38.041831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d5ce2-8098-4386-b050-51a6a2fca27e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:38.043467 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d5ce2-8098-4386-b050-51a6a2fca27e service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:38.051945 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1362/2714] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:24:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:38.398699 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc5ae-d0eb-447c-8c94-642cc9c11b4a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:38.399207 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc5ae-d0eb-447c-8c94-642cc9c11b4a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:38.399302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc5ae-d0eb-447c-8c94-642cc9c11b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:38.422658 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-3c7cc5ae-d0eb-447c-8c94-642cc9c11b4a None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:38.423776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3c7cc5ae-d0eb-447c-8c94-642cc9c11b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:38.432709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1353/2715] 10.222.0.23 () {58 vars in 967 bytes} [Tue Jun 28 03:24:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:38.448453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d5ce2-8098-4386-b050-51a6a2fca27e service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:38.465280 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d5ce2-8098-4386-b050-51a6a2fca27e service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:38.474757 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cb8c0-aa2a-4175-8af2-6262fa18a9e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:38.475940 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cb8c0-aa2a-4175-8af2-6262fa18a9e6 service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:38.476093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cb8c0-aa2a-4175-8af2-6262fa18a9e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:38.476390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cb8c0-aa2a-4175-8af2-6262fa18a9e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:38.485457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cb8c0-aa2a-4175-8af2-6262fa18a9e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:38.487175 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cb8c0-aa2a-4175-8af2-6262fa18a9e6 service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:38.495588 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1363/2716] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:24:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:38.935348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12261-83df-4a29-9c7a-7943c34cd8e3 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:38.935542 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12261-83df-4a29-9c7a-7943c34cd8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:38.935819 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12261-83df-4a29-9c7a-7943c34cd8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:38.958619 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-5ab12261-83df-4a29-9c7a-7943c34cd8e3 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:38.958619 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-5ab12261-83df-4a29-9c7a-7943c34cd8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:39.028984 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1354/2717] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 28 03:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:39.069895 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cb8c0-aa2a-4175-8af2-6262fa18a9e6 service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:39.071352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0e7cb8c0-aa2a-4175-8af2-6262fa18a9e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:39.152106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cb8c0-aa2a-4175-8af2-6262fa18a9e6 service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:39.157429 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9709b4-7bc1-4947-8467-996f2b4a1723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:39.158092 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9709b4-7bc1-4947-8467-996f2b4a1723 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:39.158401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9709b4-7bc1-4947-8467-996f2b4a1723 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:39.158675 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9709b4-7bc1-4947-8467-996f2b4a1723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:39.167706 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9709b4-7bc1-4947-8467-996f2b4a1723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:39.169213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9709b4-7bc1-4947-8467-996f2b4a1723 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:39.179039 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1364/2718] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:40.622793 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab12261-83df-4a29-9c7a-7943c34cd8e3 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:40.633874 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab12261-83df-4a29-9c7a-7943c34cd8e3 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:40.640550 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:40.641443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:40.641709 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:40.641980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] PATH_INFO: `/v3/users/d36844f594444761bb01168ebfe7c816` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:40.643401 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36844f594444761bb01168ebfe7c816)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:40.645377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:40.697447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36844f594444761bb01168ebfe7c816'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:40.698132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36844f594444761bb01168ebfe7c816'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:40.705443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36844f594444761bb01168ebfe7c816'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:40.714715 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36844f594444761bb01168ebfe7c816'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:40.731968 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36844f594444761bb01168ebfe7c816'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:40.738312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1355/2719] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:24:40 2022] DELETE /identity/v3/users/d36844f594444761bb01168ebfe7c816 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:40.743292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26124-34d6-4dbb-a915-edeb42ad0275 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:40.743765 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26124-34d6-4dbb-a915-edeb42ad0275 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:40.743862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26124-34d6-4dbb-a915-edeb42ad0275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:40.761930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5ea26124-34d6-4dbb-a915-edeb42ad0275 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:40.763160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5ea26124-34d6-4dbb-a915-edeb42ad0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:40.824118 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1365/2720] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:40.833778 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:40.835343 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:40.901792 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:40.907264 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0dab3-9047-4356-ae16-084cf3b66d8d admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:40.911585 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc940339-d4b3-4011-82e5-995e7a48e994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:40.912243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc940339-d4b3-4011-82e5-995e7a48e994 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:40.912522 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc940339-d4b3-4011-82e5-995e7a48e994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:40.912801 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc940339-d4b3-4011-82e5-995e7a48e994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:40.923386 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc940339-d4b3-4011-82e5-995e7a48e994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:40.924829 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc940339-d4b3-4011-82e5-995e7a48e994 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:40.935219 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1356/2721] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:41.109249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26124-34d6-4dbb-a915-edeb42ad0275 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:41.110802 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5ea26124-34d6-4dbb-a915-edeb42ad0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:41.123752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26124-34d6-4dbb-a915-edeb42ad0275 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:41.129150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:41.130072 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:41.130343 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:41.130617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] PATH_INFO: `/v3/projects/e454a67508794c189e3f0a750d0797a9` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:41.131969 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e454a67508794c189e3f0a750d0797a9)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:41.134102 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:41.171331 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:41.186405 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e454a67508794c189e3f0a750d0797a9', 'request_id': 'req-8f0dd808-ce6c-474e-be7e-d92797f58b0d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:41.192457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e454a67508794c189e3f0a750d0797a9', 'request_id': 'req-8f0dd808-ce6c-474e-be7e-d92797f58b0d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:41.201873 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e454a67508794c189e3f0a750d0797a9', 'request_id': 'req-8f0dd808-ce6c-474e-be7e-d92797f58b0d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:41.212654 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] The token cache is being invalidate because project e454a67508794c189e3f0a750d0797a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:24:41.212934 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:41.213676 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8f0dd808-ce6c-474e-be7e-d92797f58b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:41.215696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1366/2722] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:24:41 2022] DELETE /identity/v3/projects/e454a67508794c189e3f0a750d0797a9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:41.221212 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f68fa-dbde-490b-a6c7-8009e8fce54b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:41.221509 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f68fa-dbde-490b-a6c7-8009e8fce54b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:41.221809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f68fa-dbde-490b-a6c7-8009e8fce54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:41.239767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-de2f68fa-dbde-490b-a6c7-8009e8fce54b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:41.240965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-de2f68fa-dbde-490b-a6c7-8009e8fce54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:41.300626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1357/2723] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:41.308772 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b856b-7678-43a2-92c1-a79929598120 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:41.309025 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b856b-7678-43a2-92c1-a79929598120 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:41.309371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b856b-7678-43a2-92c1-a79929598120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:41.330752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9d6b856b-7678-43a2-92c1-a79929598120 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:41.332015 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9d6b856b-7678-43a2-92c1-a79929598120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:41.341401 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1367/2724] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:41.345915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f68fa-dbde-490b-a6c7-8009e8fce54b None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:41.356132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f68fa-dbde-490b-a6c7-8009e8fce54b None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:41.361366 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77124dea-4aad-4314-bec1-c7d2b570c172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:41.362050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124dea-4aad-4314-bec1-c7d2b570c172 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:41.362362 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124dea-4aad-4314-bec1-c7d2b570c172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:41.362634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124dea-4aad-4314-bec1-c7d2b570c172 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:41.363444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77124dea-4aad-4314-bec1-c7d2b570c172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:24:41.363828 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77124dea-4aad-4314-bec1-c7d2b570c172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:41.365760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77124dea-4aad-4314-bec1-c7d2b570c172 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:41.379249 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1358/2725] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:24:41.384111 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b856b-7678-43a2-92c1-a79929598120 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:41.393826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b856b-7678-43a2-92c1-a79929598120 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:41.398879 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38314843-1115-4404-8328-6f3ee418a1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:41.399577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38314843-1115-4404-8328-6f3ee418a1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:41.399857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38314843-1115-4404-8328-6f3ee418a1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:41.400128 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38314843-1115-4404-8328-6f3ee418a1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:41.400834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38314843-1115-4404-8328-6f3ee418a1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:41.402812 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38314843-1115-4404-8328-6f3ee418a1d6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:41.435000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1368/2726] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:24:41 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:24:41.440987 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77124dea-4aad-4314-bec1-c7d2b570c172 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:41.451872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77124dea-4aad-4314-bec1-c7d2b570c172 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:41.511700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add9797-e004-4ac0-8a4a-fda865a1326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:41.512377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add9797-e004-4ac0-8a4a-fda865a1326e admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:41.512659 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add9797-e004-4ac0-8a4a-fda865a1326e admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:41.512929 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add9797-e004-4ac0-8a4a-fda865a1326e admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:41.513621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add9797-e004-4ac0-8a4a-fda865a1326e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:41.515571 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add9797-e004-4ac0-8a4a-fda865a1326e admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:41.541696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1359/2727] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:24:41 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:24:41.545960 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38314843-1115-4404-8328-6f3ee418a1d6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:41.556664 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38314843-1115-4404-8328-6f3ee418a1d6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:41.562215 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077efec0-e0bc-4568-8d5e-4b80f0a6ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:41.562936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077efec0-e0bc-4568-8d5e-4b80f0a6ab28 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:41.563214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077efec0-e0bc-4568-8d5e-4b80f0a6ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:41.563487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077efec0-e0bc-4568-8d5e-4b80f0a6ab28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:41.564211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077efec0-e0bc-4568-8d5e-4b80f0a6ab28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:41.565813 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077efec0-e0bc-4568-8d5e-4b80f0a6ab28 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:41.577034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1369/2728] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:24:41.580710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add9797-e004-4ac0-8a4a-fda865a1326e admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:41.591606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add9797-e004-4ac0-8a4a-fda865a1326e admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:41.597381 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f09439-adce-4bbb-bc14-b218f20d1cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:41.598041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09439-adce-4bbb-bc14-b218f20d1cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:41.598320 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09439-adce-4bbb-bc14-b218f20d1cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:41.598613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09439-adce-4bbb-bc14-b218f20d1cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:41.599330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f09439-adce-4bbb-bc14-b218f20d1cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:41.600963 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f09439-adce-4bbb-bc14-b218f20d1cb7 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:41.611176 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1360/2729] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:24:41.615359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077efec0-e0bc-4568-8d5e-4b80f0a6ab28 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:41.626164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077efec0-e0bc-4568-8d5e-4b80f0a6ab28 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:41.631996 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b47743-f6ff-4d47-ad36-1437ac93479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:41.633068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47743-f6ff-4d47-ad36-1437ac93479e admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:41.633233 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47743-f6ff-4d47-ad36-1437ac93479e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:41.633425 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47743-f6ff-4d47-ad36-1437ac93479e admin admin] PATH_INFO: `/v3/projects/1931e8da430a43d7acc1e4f1cfb0151a/users/9eb21fa26b734a58b8f26df659d59672/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:41.648581 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b47743-f6ff-4d47-ad36-1437ac93479e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1931e8da430a43d7acc1e4f1cfb0151a, user_id=9eb21fa26b734a58b8f26df659d59672, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:41.651383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b47743-f6ff-4d47-ad36-1437ac93479e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:41.666976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1370/2730] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:24:41 2022] PUT /identity/v3/projects/1931e8da430a43d7acc1e4f1cfb0151a/users/9eb21fa26b734a58b8f26df659d59672/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:41.678198 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507df59-fa8f-40d7-ac0b-6d52d16856d1 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:41.678743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507df59-fa8f-40d7-ac0b-6d52d16856d1 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:41.678855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507df59-fa8f-40d7-ac0b-6d52d16856d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:41.706766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-3507df59-fa8f-40d7-ac0b-6d52d16856d1 None None] MFA Rules not processed for user `9eb21fa26b734a58b8f26df659d59672`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:41.707959 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3507df59-fa8f-40d7-ac0b-6d52d16856d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:41.764504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:41.787972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1361/2731] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:41.799885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b47743-f6ff-4d47-ad36-1437ac93479e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:41.801959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-17b47743-f6ff-4d47-ad36-1437ac93479e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:41.866312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b47743-f6ff-4d47-ad36-1437ac93479e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:41.870337 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a93b69-a40f-4d99-889c-dcf9676f7b37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:41.871029 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a93b69-a40f-4d99-889c-dcf9676f7b37 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:41.871435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a93b69-a40f-4d99-889c-dcf9676f7b37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:41.871711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a93b69-a40f-4d99-889c-dcf9676f7b37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:41.880606 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a93b69-a40f-4d99-889c-dcf9676f7b37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:41.882080 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a93b69-a40f-4d99-889c-dcf9676f7b37 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:41.892412 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1371/2732] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:42.181865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f43ed7-bc55-492d-bd7c-54610ddb6f6b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:42.182068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f43ed7-bc55-492d-bd7c-54610ddb6f6b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:42.182370 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f43ed7-bc55-492d-bd7c-54610ddb6f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:42.203324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-79f43ed7-bc55-492d-bd7c-54610ddb6f6b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:42.204680 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-79f43ed7-bc55-492d-bd7c-54610ddb6f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:42.271400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1362/2733] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 28 03:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:42.294877 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a93b69-a40f-4d99-889c-dcf9676f7b37 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:42.296427 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f1a93b69-a40f-4d99-889c-dcf9676f7b37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:42.375019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:42.396588 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a93b69-a40f-4d99-889c-dcf9676f7b37 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:42.402673 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b18b40-fc47-4556-841d-53a6991b8d07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:42.403335 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18b40-fc47-4556-841d-53a6991b8d07 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:42.403616 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18b40-fc47-4556-841d-53a6991b8d07 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:42.403888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18b40-fc47-4556-841d-53a6991b8d07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:42.412097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b18b40-fc47-4556-841d-53a6991b8d07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:42.413690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b18b40-fc47-4556-841d-53a6991b8d07 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:42.423040 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1372/2734] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:45.284501 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1fa7-ccb1-49f1-b4f2-dd1a57f6c656 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:45.285093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1fa7-ccb1-49f1-b4f2-dd1a57f6c656 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:45.285093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1fa7-ccb1-49f1-b4f2-dd1a57f6c656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:45.305190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-22ca1fa7-ccb1-49f1-b4f2-dd1a57f6c656 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:45.306349 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-22ca1fa7-ccb1-49f1-b4f2-dd1a57f6c656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:45.316209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1363/2735] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 28 03:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:45.338002 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b18b40-fc47-4556-841d-53a6991b8d07 service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:45.340253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e2b18b40-fc47-4556-841d-53a6991b8d07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:45.355386 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b18b40-fc47-4556-841d-53a6991b8d07 service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:45.361788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abe865-e233-4059-a472-45903097f9b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:45.362465 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abe865-e233-4059-a472-45903097f9b1 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:45.362742 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abe865-e233-4059-a472-45903097f9b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:45.363018 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abe865-e233-4059-a472-45903097f9b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:45.371994 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abe865-e233-4059-a472-45903097f9b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:45.373584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abe865-e233-4059-a472-45903097f9b1 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:45.383711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1373/2736] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:46.936613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca1fa7-ccb1-49f1-b4f2-dd1a57f6c656 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:46.946814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca1fa7-ccb1-49f1-b4f2-dd1a57f6c656 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:46.952737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:46.953625 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:46.953887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:46.954158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] PATH_INFO: `/v3/users/9eb21fa26b734a58b8f26df659d59672` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:46.955551 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb21fa26b734a58b8f26df659d59672)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:46.957567 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:47.008464 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb21fa26b734a58b8f26df659d59672'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:47.009101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb21fa26b734a58b8f26df659d59672'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:47.016434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb21fa26b734a58b8f26df659d59672'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:47.025399 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb21fa26b734a58b8f26df659d59672'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:47.038093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb21fa26b734a58b8f26df659d59672'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:47.044934 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1364/2737] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:24:46 2022] DELETE /identity/v3/users/9eb21fa26b734a58b8f26df659d59672 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:24:47.050351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26939904-a239-4265-9c36-2d7e21126273 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:47.050351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26939904-a239-4265-9c36-2d7e21126273 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:47.050351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26939904-a239-4265-9c36-2d7e21126273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:47.069008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-26939904-a239-4265-9c36-2d7e21126273 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:47.070221 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-26939904-a239-4265-9c36-2d7e21126273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:47.131854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1374/2738] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:47.142047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:47.143885 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:47.206511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac966dd-a0ef-442b-be92-5cb1d77d8450 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:47.210479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cf17b-515d-497c-bb3f-9913d77a64e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:47.211128 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cf17b-515d-497c-bb3f-9913d77a64e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:47.211426 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cf17b-515d-497c-bb3f-9913d77a64e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:47.211698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cf17b-515d-497c-bb3f-9913d77a64e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:47.219228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:47.223520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cf17b-515d-497c-bb3f-9913d77a64e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:47.225298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cf17b-515d-497c-bb3f-9913d77a64e8 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:47.236138 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1365/2739] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:24:47.514513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26939904-a239-4265-9c36-2d7e21126273 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:47.516270 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-26939904-a239-4265-9c36-2d7e21126273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:47.528935 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26939904-a239-4265-9c36-2d7e21126273 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:47.535194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:47.536098 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:47.536382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:47.536645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] PATH_INFO: `/v3/projects/1931e8da430a43d7acc1e4f1cfb0151a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:47.537958 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1931e8da430a43d7acc1e4f1cfb0151a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:47.539973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:47.594990 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1931e8da430a43d7acc1e4f1cfb0151a', 'request_id': 'req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:47.601214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1931e8da430a43d7acc1e4f1cfb0151a', 'request_id': 'req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:47.610231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1931e8da430a43d7acc1e4f1cfb0151a', 'request_id': 'req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:47.620831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] The token cache is being invalidate because project 1931e8da430a43d7acc1e4f1cfb0151a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:24:47.621288 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:47.622097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:24:47.623834 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1375/2740] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:24:47 2022] DELETE /identity/v3/projects/1931e8da430a43d7acc1e4f1cfb0151a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:24:48.444325 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d250cf7-6911-4073-80a6-92aadf0f50c5 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:48.444875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d250cf7-6911-4073-80a6-92aadf0f50c5 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:48.444875 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d250cf7-6911-4073-80a6-92aadf0f50c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:48.463237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6d250cf7-6911-4073-80a6-92aadf0f50c5 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:48.464493 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6d250cf7-6911-4073-80a6-92aadf0f50c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:48.527243 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1366/2741] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 28 03:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:48.552825 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:48.554417 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:48.607898 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:48.631021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45ab0-a0ae-47c6-a3e6-3d6311ef0ef3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:48.636915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22534ca8-7ec9-4491-8c65-1f9343f72611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:48.637567 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22534ca8-7ec9-4491-8c65-1f9343f72611 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:48.637831 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22534ca8-7ec9-4491-8c65-1f9343f72611 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:48.638126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22534ca8-7ec9-4491-8c65-1f9343f72611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:48.646508 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22534ca8-7ec9-4491-8c65-1f9343f72611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:48.648101 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22534ca8-7ec9-4491-8c65-1f9343f72611 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:48.658194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1376/2742] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:24:51.643637 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e62e11-8d73-4ac8-8077-4fec3cce648f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:51.644560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e62e11-8d73-4ac8-8077-4fec3cce648f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:51.644560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e62e11-8d73-4ac8-8077-4fec3cce648f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:51.669621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-82e62e11-8d73-4ac8-8077-4fec3cce648f None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:24:51.670876 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-82e62e11-8d73-4ac8-8077-4fec3cce648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:51.680999 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1367/2743] 10.222.0.15 () {58 vars in 1016 bytes} [Tue Jun 28 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:24:51.704413 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22534ca8-7ec9-4491-8c65-1f9343f72611 service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:24:51.706094 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-22534ca8-7ec9-4491-8c65-1f9343f72611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:24:51.721850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22534ca8-7ec9-4491-8c65-1f9343f72611 service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:24:51.729186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13487442-c882-4541-8467-a631c4b2ca45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1868e9d8b004c4fb781e532c775428e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:24:51.729829 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13487442-c882-4541-8467-a631c4b2ca45 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:24:51.730109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13487442-c882-4541-8467-a631c4b2ca45 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:24:51.730410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13487442-c882-4541-8467-a631c4b2ca45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:24:51.739766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13487442-c882-4541-8467-a631c4b2ca45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:24:51.741284 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13487442-c882-4541-8467-a631c4b2ca45 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:24:51.751416 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1377/2744] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:01.663475 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=33 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:01.746694 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=17 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:05.550416 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e62e11-8d73-4ac8-8077-4fec3cce648f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:05.552010 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-82e62e11-8d73-4ac8-8077-4fec3cce648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:05.611857 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e62e11-8d73-4ac8-8077-4fec3cce648f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:05.615909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c6acd-7e64-4d4d-858e-0e54b00a8bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:05.616566 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6acd-7e64-4d4d-858e-0e54b00a8bab service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:05.616846 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6acd-7e64-4d4d-858e-0e54b00a8bab service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:05.617133 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6acd-7e64-4d4d-858e-0e54b00a8bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:05.619076 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-112c6acd-7e64-4d4d-858e-0e54b00a8bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:05.631369 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c6acd-7e64-4d4d-858e-0e54b00a8bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:05.632800 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c6acd-7e64-4d4d-858e-0e54b00a8bab service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:05.642936 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1368/2745] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:08.718995 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13487442-c882-4541-8467-a631c4b2ca45 service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:08.720936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-13487442-c882-4541-8467-a631c4b2ca45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:08.777479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c6acd-7e64-4d4d-858e-0e54b00a8bab service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:08.779041 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-112c6acd-7e64-4d4d-858e-0e54b00a8bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:08.802884 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c6acd-7e64-4d4d-858e-0e54b00a8bab service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:08.808118 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be647d1f-3439-47cf-91b0-33f0b60f22d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:08.809028 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be647d1f-3439-47cf-91b0-33f0b60f22d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:08.809309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be647d1f-3439-47cf-91b0-33f0b60f22d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:08.810085 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be647d1f-3439-47cf-91b0-33f0b60f22d9 admin admin] PATH_INFO: `/v3/users/48ed1f29820f44bdb78f59bce994c840` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:08.816265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be647d1f-3439-47cf-91b0-33f0b60f22d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ed1f29820f44bdb78f59bce994c840)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:08.818773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be647d1f-3439-47cf-91b0-33f0b60f22d9 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:08.831995 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13487442-c882-4541-8467-a631c4b2ca45 service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:08.838890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2853a-5ab4-4cbd-a6f1-23939b69655f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8048235c6421eae12ca99f80ed5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:08.840200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2853a-5ab4-4cbd-a6f1-23939b69655f service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:08.840584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2853a-5ab4-4cbd-a6f1-23939b69655f service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:08.840954 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2853a-5ab4-4cbd-a6f1-23939b69655f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:08.843774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-38e2853a-5ab4-4cbd-a6f1-23939b69655f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:08.857658 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2853a-5ab4-4cbd-a6f1-23939b69655f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:08.860045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2853a-5ab4-4cbd-a6f1-23939b69655f service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:08.882442 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1378/2746] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:08.886479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-be647d1f-3439-47cf-91b0-33f0b60f22d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ed1f29820f44bdb78f59bce994c840'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:08.887305 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-be647d1f-3439-47cf-91b0-33f0b60f22d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ed1f29820f44bdb78f59bce994c840'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:08.895365 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-be647d1f-3439-47cf-91b0-33f0b60f22d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ed1f29820f44bdb78f59bce994c840'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:08.910282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-be647d1f-3439-47cf-91b0-33f0b60f22d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ed1f29820f44bdb78f59bce994c840'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:08.923452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-be647d1f-3439-47cf-91b0-33f0b60f22d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ed1f29820f44bdb78f59bce994c840'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:08.930577 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1369/2747] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:08 2022] DELETE /identity/v3/users/48ed1f29820f44bdb78f59bce994c840 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:09.107229 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2853a-5ab4-4cbd-a6f1-23939b69655f service placement] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:09.122235 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2853a-5ab4-4cbd-a6f1-23939b69655f service placement] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:09.184459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:09.185355 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:09.185640 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:09.185917 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] PATH_INFO: `/v3/projects/308d0d3a16c64139a9d7e768622315b2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:09.187291 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=308d0d3a16c64139a9d7e768622315b2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:09.189278 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:09.246181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308d0d3a16c64139a9d7e768622315b2', 'request_id': 'req-effa4c9e-5f51-4796-b927-a2cf71fcb659'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:09.253308 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308d0d3a16c64139a9d7e768622315b2', 'request_id': 'req-effa4c9e-5f51-4796-b927-a2cf71fcb659'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:09.262249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308d0d3a16c64139a9d7e768622315b2', 'request_id': 'req-effa4c9e-5f51-4796-b927-a2cf71fcb659'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:09.283485 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] The token cache is being invalidate because project 308d0d3a16c64139a9d7e768622315b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:09.283752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:09.284385 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-effa4c9e-5f51-4796-b927-a2cf71fcb659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:09.286038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1379/2748] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:09 2022] DELETE /identity/v3/projects/308d0d3a16c64139a9d7e768622315b2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:09.291027 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb744fe-d36a-4876-93d6-7955d19e991d None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:09.291317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb744fe-d36a-4876-93d6-7955d19e991d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:09.291593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb744fe-d36a-4876-93d6-7955d19e991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:09.312880 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-fcb744fe-d36a-4876-93d6-7955d19e991d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:09.314278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-fcb744fe-d36a-4876-93d6-7955d19e991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:09.379122 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1370/2749] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:09.388013 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401cd1-fe59-46b6-88cc-625bee57a238 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:09.388299 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401cd1-fe59-46b6-88cc-625bee57a238 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:09.388570 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401cd1-fe59-46b6-88cc-625bee57a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:09.408667 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fe401cd1-fe59-46b6-88cc-625bee57a238 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:09.409874 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fe401cd1-fe59-46b6-88cc-625bee57a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:09.418161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1380/2750] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:09.422586 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb744fe-d36a-4876-93d6-7955d19e991d None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:09.432614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb744fe-d36a-4876-93d6-7955d19e991d None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:09.437553 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6e97b-b5f7-4056-9cce-07ca34ac90d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:09.438336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6e97b-b5f7-4056-9cce-07ca34ac90d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:09.438630 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6e97b-b5f7-4056-9cce-07ca34ac90d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:09.438904 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6e97b-b5f7-4056-9cce-07ca34ac90d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:09.439648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6e97b-b5f7-4056-9cce-07ca34ac90d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:25:09.439950 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6e97b-b5f7-4056-9cce-07ca34ac90d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:09.441664 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6e97b-b5f7-4056-9cce-07ca34ac90d3 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:09.454038 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1371/2751] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:25:09.459161 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401cd1-fe59-46b6-88cc-625bee57a238 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:09.471194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401cd1-fe59-46b6-88cc-625bee57a238 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:09.477726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cb16d-84a3-4bd1-994e-6f95a43df1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:09.478424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cb16d-84a3-4bd1-994e-6f95a43df1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:09.478710 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cb16d-84a3-4bd1-994e-6f95a43df1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:09.478978 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cb16d-84a3-4bd1-994e-6f95a43df1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:09.479681 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cb16d-84a3-4bd1-994e-6f95a43df1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:09.481603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cb16d-84a3-4bd1-994e-6f95a43df1e5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:09.493248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:09.512937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1381/2752] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:25:09 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:09.517483 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6e97b-b5f7-4056-9cce-07ca34ac90d3 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:09.525544 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:09.532916 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6e97b-b5f7-4056-9cce-07ca34ac90d3 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:09.594397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390c5e5-ecc0-4b8d-b088-7d5672f26801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:09.595342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390c5e5-ecc0-4b8d-b088-7d5672f26801 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:09.595621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390c5e5-ecc0-4b8d-b088-7d5672f26801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:09.595888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390c5e5-ecc0-4b8d-b088-7d5672f26801 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:09.596593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390c5e5-ecc0-4b8d-b088-7d5672f26801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:09.598504 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390c5e5-ecc0-4b8d-b088-7d5672f26801 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:09.624280 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1372/2753] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:25:09 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:09.628743 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cb16d-84a3-4bd1-994e-6f95a43df1e5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:09.639286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cb16d-84a3-4bd1-994e-6f95a43df1e5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:09.644166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85b2ff-fb25-4b90-be95-2c4bd76843bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:09.644826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85b2ff-fb25-4b90-be95-2c4bd76843bb admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:09.645108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85b2ff-fb25-4b90-be95-2c4bd76843bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:09.645433 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85b2ff-fb25-4b90-be95-2c4bd76843bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:09.646155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85b2ff-fb25-4b90-be95-2c4bd76843bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:09.647844 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85b2ff-fb25-4b90-be95-2c4bd76843bb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:09.658843 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1382/2754] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:09.663009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390c5e5-ecc0-4b8d-b088-7d5672f26801 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:09.673845 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390c5e5-ecc0-4b8d-b088-7d5672f26801 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:09.679173 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e58b0-3c72-4f81-a420-d5f468a18b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:09.679847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e58b0-3c72-4f81-a420-d5f468a18b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:09.680129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e58b0-3c72-4f81-a420-d5f468a18b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:09.680402 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e58b0-3c72-4f81-a420-d5f468a18b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:09.681170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e58b0-3c72-4f81-a420-d5f468a18b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:09.682775 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e58b0-3c72-4f81-a420-d5f468a18b22 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:09.694058 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1373/2755] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:25:09.697756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85b2ff-fb25-4b90-be95-2c4bd76843bb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:09.708314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85b2ff-fb25-4b90-be95-2c4bd76843bb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:09.712914 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5b34b-0e8f-4807-97c1-90a2fa8f1730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:09.713801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b34b-0e8f-4807-97c1-90a2fa8f1730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:09.714476 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b34b-0e8f-4807-97c1-90a2fa8f1730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:09.714748 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b34b-0e8f-4807-97c1-90a2fa8f1730 admin admin] PATH_INFO: `/v3/projects/306c7687791d4471a9f52ea05042d5fb/users/666b1c4959034d079fa0398dde582f8f/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:09.729920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5b34b-0e8f-4807-97c1-90a2fa8f1730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306c7687791d4471a9f52ea05042d5fb, user_id=666b1c4959034d079fa0398dde582f8f, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:09.732600 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5b34b-0e8f-4807-97c1-90a2fa8f1730 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:09.746559 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1383/2756] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:09 2022] PUT /identity/v3/projects/306c7687791d4471a9f52ea05042d5fb/users/666b1c4959034d079fa0398dde582f8f/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:09.751961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec5b35-78fa-4098-ac33-d400d3bed211 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:09.752248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec5b35-78fa-4098-ac33-d400d3bed211 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:09.752520 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec5b35-78fa-4098-ac33-d400d3bed211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:09.773168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-bfec5b35-78fa-4098-ac33-d400d3bed211 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:09.774486 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-bfec5b35-78fa-4098-ac33-d400d3bed211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:09.842385 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1374/2757] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:25:09.853822 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5b34b-0e8f-4807-97c1-90a2fa8f1730 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:09.855771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-94c5b34b-0e8f-4807-97c1-90a2fa8f1730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:09.914622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5b34b-0e8f-4807-97c1-90a2fa8f1730 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:09.918513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee578f-629f-4a32-8ed5-2b8d849c88d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:09.919167 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee578f-629f-4a32-8ed5-2b8d849c88d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:09.919450 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee578f-629f-4a32-8ed5-2b8d849c88d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:09.919725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee578f-629f-4a32-8ed5-2b8d849c88d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:09.929477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee578f-629f-4a32-8ed5-2b8d849c88d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:09.930959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee578f-629f-4a32-8ed5-2b8d849c88d8 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:09.940665 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1384/2758] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:10.562537 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6604ce9-d938-4cf3-9a2b-3bfc10a6fd9f None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:10.562915 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6604ce9-d938-4cf3-9a2b-3bfc10a6fd9f None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:10.563177 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6604ce9-d938-4cf3-9a2b-3bfc10a6fd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:10.600371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-c6604ce9-d938-4cf3-9a2b-3bfc10a6fd9f None None] MFA Rules not processed for user `666b1c4959034d079fa0398dde582f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:10.601803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c6604ce9-d938-4cf3-9a2b-3bfc10a6fd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:10.669532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1375/2759] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:10.674390 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee578f-629f-4a32-8ed5-2b8d849c88d8 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:10.684265 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee578f-629f-4a32-8ed5-2b8d849c88d8 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:10.689264 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbad43-9f53-4e49-af8a-083d29ce7ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:10.690009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbad43-9f53-4e49-af8a-083d29ce7ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:10.690389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbad43-9f53-4e49-af8a-083d29ce7ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:10.690722 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbad43-9f53-4e49-af8a-083d29ce7ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:10.691490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbad43-9f53-4e49-af8a-083d29ce7ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:10.693470 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbad43-9f53-4e49-af8a-083d29ce7ea6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:10.720660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1385/2760] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:25:10 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:10.724914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6604ce9-d938-4cf3-9a2b-3bfc10a6fd9f None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:10.736468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6604ce9-d938-4cf3-9a2b-3bfc10a6fd9f None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:10.746590 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:10.801564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aac41a-8ef3-4f38-b974-85003fdafaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:10.802315 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aac41a-8ef3-4f38-b974-85003fdafaee admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:10.802696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aac41a-8ef3-4f38-b974-85003fdafaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:10.803071 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aac41a-8ef3-4f38-b974-85003fdafaee admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:10.804163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aac41a-8ef3-4f38-b974-85003fdafaee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:10.807649 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aac41a-8ef3-4f38-b974-85003fdafaee admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:10.835324 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1376/2761] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:25:10 2022] POST /identity/v3/users => generated 309 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:10.842571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbad43-9f53-4e49-af8a-083d29ce7ea6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:10.853467 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbad43-9f53-4e49-af8a-083d29ce7ea6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:10.858700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf25a7-55d3-4fc3-bc59-664d89adc527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:10.859373 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf25a7-55d3-4fc3-bc59-664d89adc527 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:10.859763 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf25a7-55d3-4fc3-bc59-664d89adc527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:10.860397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf25a7-55d3-4fc3-bc59-664d89adc527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:10.860909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf25a7-55d3-4fc3-bc59-664d89adc527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:10.863160 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf25a7-55d3-4fc3-bc59-664d89adc527 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:10.877060 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1386/2762] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:10.882676 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aac41a-8ef3-4f38-b974-85003fdafaee admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:10.895454 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aac41a-8ef3-4f38-b974-85003fdafaee admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:10.901656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd93d8-2496-4b39-bc84-bbbe8963e0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:10.902589 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd93d8-2496-4b39-bc84-bbbe8963e0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:10.902870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd93d8-2496-4b39-bc84-bbbe8963e0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:10.903141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd93d8-2496-4b39-bc84-bbbe8963e0c9 admin admin] PATH_INFO: `/v3/projects/8292926eb2b3430e91052f6b99ccb48e/users/f3f774dd14084291908396d717d16672/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:10.920013 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd93d8-2496-4b39-bc84-bbbe8963e0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8292926eb2b3430e91052f6b99ccb48e, user_id=f3f774dd14084291908396d717d16672, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:10.922768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd93d8-2496-4b39-bc84-bbbe8963e0c9 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:10.937102 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1377/2763] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:10 2022] PUT /identity/v3/projects/8292926eb2b3430e91052f6b99ccb48e/users/f3f774dd14084291908396d717d16672/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:10.941863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf25a7-55d3-4fc3-bc59-664d89adc527 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:10.952426 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf25a7-55d3-4fc3-bc59-664d89adc527 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:11.012097 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a60267-043b-4264-9e87-8756c5b12280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:11.012785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a60267-043b-4264-9e87-8756c5b12280 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:11.013067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a60267-043b-4264-9e87-8756c5b12280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:11.013340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a60267-043b-4264-9e87-8756c5b12280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:11.014068 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a60267-043b-4264-9e87-8756c5b12280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:11.015724 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a60267-043b-4264-9e87-8756c5b12280 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:11.025910 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1387/2764] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:11.030976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd93d8-2496-4b39-bc84-bbbe8963e0c9 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:11.042424 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd93d8-2496-4b39-bc84-bbbe8963e0c9 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:11.047331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f01b8-3ae2-4106-b6d8-a2c034853551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:11.048330 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f01b8-3ae2-4106-b6d8-a2c034853551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:11.048612 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f01b8-3ae2-4106-b6d8-a2c034853551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:11.048886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f01b8-3ae2-4106-b6d8-a2c034853551 admin admin] PATH_INFO: `/v3/projects/8292926eb2b3430e91052f6b99ccb48e/users/f3f774dd14084291908396d717d16672/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:11.051209 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f01b8-3ae2-4106-b6d8-a2c034853551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8292926eb2b3430e91052f6b99ccb48e, user_id=f3f774dd14084291908396d717d16672, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:11.054026 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f01b8-3ae2-4106-b6d8-a2c034853551 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:11.068752 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1378/2765] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:11 2022] PUT /identity/v3/projects/8292926eb2b3430e91052f6b99ccb48e/users/f3f774dd14084291908396d717d16672/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:11.705513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18072632-330c-4b54-94d8-bdbd33e49169 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:11.705788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18072632-330c-4b54-94d8-bdbd33e49169 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:11.706096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18072632-330c-4b54-94d8-bdbd33e49169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:11.733802 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-18072632-330c-4b54-94d8-bdbd33e49169 None None] MFA Rules not processed for user `f3f774dd14084291908396d717d16672`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:11.735052 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-18072632-330c-4b54-94d8-bdbd33e49169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:11.744761 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:11.810057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1388/2766] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:12.889211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f01b8-3ae2-4106-b6d8-a2c034853551 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:12.959488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f01b8-3ae2-4106-b6d8-a2c034853551 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:12.965639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:12.966565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:12.966841 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:12.967109 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] PATH_INFO: `/v3/users/666b1c4959034d079fa0398dde582f8f` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:12.968429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=666b1c4959034d079fa0398dde582f8f)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:12.972119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:13.023439 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666b1c4959034d079fa0398dde582f8f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.024114 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666b1c4959034d079fa0398dde582f8f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.031391 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666b1c4959034d079fa0398dde582f8f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.042300 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666b1c4959034d079fa0398dde582f8f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.045222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:13.059584 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666b1c4959034d079fa0398dde582f8f'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.065690 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1379/2767] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:12 2022] DELETE /identity/v3/users/666b1c4959034d079fa0398dde582f8f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:13.244347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18072632-330c-4b54-94d8-bdbd33e49169 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:13.255261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18072632-330c-4b54-94d8-bdbd33e49169 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:13.312459 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:13.313329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:13.313607 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:13.313876 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] PATH_INFO: `/v3/projects/306c7687791d4471a9f52ea05042d5fb` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:13.315214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306c7687791d4471a9f52ea05042d5fb)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:13.317165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:13.374037 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306c7687791d4471a9f52ea05042d5fb', 'request_id': 'req-4f0f961e-0069-4328-8339-db50eca450c4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.381324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306c7687791d4471a9f52ea05042d5fb', 'request_id': 'req-4f0f961e-0069-4328-8339-db50eca450c4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.391535 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306c7687791d4471a9f52ea05042d5fb', 'request_id': 'req-4f0f961e-0069-4328-8339-db50eca450c4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.402827 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] The token cache is being invalidate because project 306c7687791d4471a9f52ea05042d5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:13.403108 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.403754 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.405354 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1389/2768] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:13 2022] DELETE /identity/v3/projects/306c7687791d4471a9f52ea05042d5fb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:13.410240 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:13.411711 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:13.425536 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8c892-c047-4e4f-82e5-0435fa7eb6b7 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:13.495141 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34318209-d07b-463a-8077-6604ffde7adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:13.496046 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34318209-d07b-463a-8077-6604ffde7adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:13.496342 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34318209-d07b-463a-8077-6604ffde7adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:13.496707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34318209-d07b-463a-8077-6604ffde7adc admin admin] PATH_INFO: `/v3/users/f3f774dd14084291908396d717d16672` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:13.497866 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34318209-d07b-463a-8077-6604ffde7adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f774dd14084291908396d717d16672)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:13.500119 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34318209-d07b-463a-8077-6604ffde7adc admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:13.551518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-34318209-d07b-463a-8077-6604ffde7adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f774dd14084291908396d717d16672'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.552167 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-34318209-d07b-463a-8077-6604ffde7adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f774dd14084291908396d717d16672'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.559296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-34318209-d07b-463a-8077-6604ffde7adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f774dd14084291908396d717d16672'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.568274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-34318209-d07b-463a-8077-6604ffde7adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f774dd14084291908396d717d16672'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.584068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-34318209-d07b-463a-8077-6604ffde7adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f774dd14084291908396d717d16672'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.590654 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1380/2769] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:13 2022] DELETE /identity/v3/users/f3f774dd14084291908396d717d16672 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:13.782245 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:13.783927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:13.807293 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f961e-0069-4328-8339-db50eca450c4 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:13.844082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:13.870550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:13.871437 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:13.871715 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:13.871989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] PATH_INFO: `/v3/projects/8292926eb2b3430e91052f6b99ccb48e` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:13.873218 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8292926eb2b3430e91052f6b99ccb48e)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:13.875213 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:13.923735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8292926eb2b3430e91052f6b99ccb48e', 'request_id': 'req-76934ebc-69fa-47ec-9eb4-05e539d5106a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.929793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8292926eb2b3430e91052f6b99ccb48e', 'request_id': 'req-76934ebc-69fa-47ec-9eb4-05e539d5106a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.939381 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8292926eb2b3430e91052f6b99ccb48e', 'request_id': 'req-76934ebc-69fa-47ec-9eb4-05e539d5106a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.951383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] The token cache is being invalidate because project 8292926eb2b3430e91052f6b99ccb48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:13.951669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.952291 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-76934ebc-69fa-47ec-9eb4-05e539d5106a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:13.953977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1390/2770] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:13 2022] DELETE /identity/v3/projects/8292926eb2b3430e91052f6b99ccb48e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:13.959183 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7095b7-b164-4c29-a903-2c4e928035b3 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:13.959655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7095b7-b164-4c29-a903-2c4e928035b3 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:13.959749 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7095b7-b164-4c29-a903-2c4e928035b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:13.978965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6f7095b7-b164-4c29-a903-2c4e928035b3 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:13.980165 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6f7095b7-b164-4c29-a903-2c4e928035b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:14.042307 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1381/2771] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:25:14.050510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c21f2b-59e5-474d-89e9-02eef0659031 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.050799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c21f2b-59e5-474d-89e9-02eef0659031 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.051090 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c21f2b-59e5-474d-89e9-02eef0659031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.073091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c2c21f2b-59e5-474d-89e9-02eef0659031 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:14.074315 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c2c21f2b-59e5-474d-89e9-02eef0659031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:14.082668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1391/2772] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:14.087190 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7095b7-b164-4c29-a903-2c4e928035b3 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.092624 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:14.099820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7095b7-b164-4c29-a903-2c4e928035b3 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.105842 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d300-930f-42fb-a545-8b061789d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.106594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d300-930f-42fb-a545-8b061789d85a admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.106877 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d300-930f-42fb-a545-8b061789d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.107136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d300-930f-42fb-a545-8b061789d85a admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.107871 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d300-930f-42fb-a545-8b061789d85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:25:14.108179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d300-930f-42fb-a545-8b061789d85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.109812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d300-930f-42fb-a545-8b061789d85a admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.121693 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1382/2773] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:25:14.126417 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c21f2b-59e5-474d-89e9-02eef0659031 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.136084 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c21f2b-59e5-474d-89e9-02eef0659031 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.141347 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ea758-468b-42ff-9427-7d10fa8d4366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.141999 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ea758-468b-42ff-9427-7d10fa8d4366 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.142282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ea758-468b-42ff-9427-7d10fa8d4366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.142584 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ea758-468b-42ff-9427-7d10fa8d4366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.143272 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ea758-468b-42ff-9427-7d10fa8d4366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.145202 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ea758-468b-42ff-9427-7d10fa8d4366 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.172766 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1392/2774] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:25:14 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:25:14.176973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d300-930f-42fb-a545-8b061789d85a admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.187036 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d300-930f-42fb-a545-8b061789d85a admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.245981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d812d34-2435-4fc3-8299-eac928a8abdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.246665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812d34-2435-4fc3-8299-eac928a8abdd admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.246942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812d34-2435-4fc3-8299-eac928a8abdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.247211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812d34-2435-4fc3-8299-eac928a8abdd admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.247923 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d812d34-2435-4fc3-8299-eac928a8abdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.249837 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d812d34-2435-4fc3-8299-eac928a8abdd admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.272594 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1383/2775] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:25:14 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:14.279039 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ea758-468b-42ff-9427-7d10fa8d4366 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.291773 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ea758-468b-42ff-9427-7d10fa8d4366 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.297996 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb42607-9336-4068-bda8-bb7f8af16c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.298731 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb42607-9336-4068-bda8-bb7f8af16c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.299199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb42607-9336-4068-bda8-bb7f8af16c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.299467 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb42607-9336-4068-bda8-bb7f8af16c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.300543 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb42607-9336-4068-bda8-bb7f8af16c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.302329 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb42607-9336-4068-bda8-bb7f8af16c60 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.314815 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1393/2776] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:14.319248 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d812d34-2435-4fc3-8299-eac928a8abdd admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.330430 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d812d34-2435-4fc3-8299-eac928a8abdd admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.335569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818a53b-480e-4a94-95d9-d883407adfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.336255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a53b-480e-4a94-95d9-d883407adfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.336516 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a53b-480e-4a94-95d9-d883407adfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.336781 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a53b-480e-4a94-95d9-d883407adfe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.337511 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818a53b-480e-4a94-95d9-d883407adfe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.339496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818a53b-480e-4a94-95d9-d883407adfe6 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.350512 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1384/2777] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:14.354839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb42607-9336-4068-bda8-bb7f8af16c60 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.365356 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb42607-9336-4068-bda8-bb7f8af16c60 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.370801 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5dcb6-3f7d-4f50-b3cd-622818e6ccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.371682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5dcb6-3f7d-4f50-b3cd-622818e6ccd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.372148 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5dcb6-3f7d-4f50-b3cd-622818e6ccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.372418 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5dcb6-3f7d-4f50-b3cd-622818e6ccd6 admin admin] PATH_INFO: `/v3/projects/35d743bb309942a6be7a996c4a02d700/users/b93debd6a43741c7aad3f4c3dbb4420d/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.387227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5dcb6-3f7d-4f50-b3cd-622818e6ccd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d743bb309942a6be7a996c4a02d700, user_id=b93debd6a43741c7aad3f4c3dbb4420d, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.389875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5dcb6-3f7d-4f50-b3cd-622818e6ccd6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.404858 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1394/2778] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:14 2022] PUT /identity/v3/projects/35d743bb309942a6be7a996c4a02d700/users/b93debd6a43741c7aad3f4c3dbb4420d/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:14.415914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e72c8-adb2-4a6c-90d9-a0960e93bb84 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.416208 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e72c8-adb2-4a6c-90d9-a0960e93bb84 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.416479 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e72c8-adb2-4a6c-90d9-a0960e93bb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.455139 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-3b0e72c8-adb2-4a6c-90d9-a0960e93bb84 None None] MFA Rules not processed for user `b93debd6a43741c7aad3f4c3dbb4420d`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:14.456357 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3b0e72c8-adb2-4a6c-90d9-a0960e93bb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:14.524864 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1385/2779] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:14.530091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5dcb6-3f7d-4f50-b3cd-622818e6ccd6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.598248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5dcb6-3f7d-4f50-b3cd-622818e6ccd6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.604176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4230-ea55-4bc4-a71b-52e9925eae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.604784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4230-ea55-4bc4-a71b-52e9925eae46 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.605082 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4230-ea55-4bc4-a71b-52e9925eae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.605352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4230-ea55-4bc4-a71b-52e9925eae46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.606253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4230-ea55-4bc4-a71b-52e9925eae46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.608824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4230-ea55-4bc4-a71b-52e9925eae46 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.618247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:14.642922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1395/2780] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:25:14 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:14.644204 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e72c8-adb2-4a6c-90d9-a0960e93bb84 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.655217 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e72c8-adb2-4a6c-90d9-a0960e93bb84 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.717443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:14.727152 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe6c8f-022b-4f5f-b36a-a89afdcd9455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.728179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe6c8f-022b-4f5f-b36a-a89afdcd9455 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.728480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe6c8f-022b-4f5f-b36a-a89afdcd9455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.728766 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe6c8f-022b-4f5f-b36a-a89afdcd9455 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.729492 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe6c8f-022b-4f5f-b36a-a89afdcd9455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.731722 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe6c8f-022b-4f5f-b36a-a89afdcd9455 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.756369 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1386/2781] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:25:14 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:14.758045 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4230-ea55-4bc4-a71b-52e9925eae46 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.768637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4230-ea55-4bc4-a71b-52e9925eae46 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.773227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c31f4-2ce5-4db0-a332-e6c304f39a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.773887 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c31f4-2ce5-4db0-a332-e6c304f39a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.774166 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c31f4-2ce5-4db0-a332-e6c304f39a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.774477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c31f4-2ce5-4db0-a332-e6c304f39a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.775207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c31f4-2ce5-4db0-a332-e6c304f39a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.776810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c31f4-2ce5-4db0-a332-e6c304f39a1e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.787936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1396/2782] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:14.792051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe6c8f-022b-4f5f-b36a-a89afdcd9455 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.802785 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe6c8f-022b-4f5f-b36a-a89afdcd9455 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.808174 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7f882-228b-488f-9776-81f3964a82d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.809348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7f882-228b-488f-9776-81f3964a82d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.809631 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7f882-228b-488f-9776-81f3964a82d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.809909 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7f882-228b-488f-9776-81f3964a82d8 admin admin] PATH_INFO: `/v3/projects/2f5727a094a84f4e9b57581c4f141f6f/users/375b52538b3f4a5995ab164860b1a934/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.827461 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7f882-228b-488f-9776-81f3964a82d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5727a094a84f4e9b57581c4f141f6f, user_id=375b52538b3f4a5995ab164860b1a934, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.830931 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7f882-228b-488f-9776-81f3964a82d8 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.846317 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1387/2783] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:14 2022] PUT /identity/v3/projects/2f5727a094a84f4e9b57581c4f141f6f/users/375b52538b3f4a5995ab164860b1a934/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:14.850683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c31f4-2ce5-4db0-a332-e6c304f39a1e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.861582 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c31f4-2ce5-4db0-a332-e6c304f39a1e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.921785 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5208d15-d42c-4bc4-bf5e-7577a5914c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.922521 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5208d15-d42c-4bc4-bf5e-7577a5914c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.922980 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5208d15-d42c-4bc4-bf5e-7577a5914c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.923106 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5208d15-d42c-4bc4-bf5e-7577a5914c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.923901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5208d15-d42c-4bc4-bf5e-7577a5914c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.925547 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5208d15-d42c-4bc4-bf5e-7577a5914c38 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.935534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1397/2784] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:14.939971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7f882-228b-488f-9776-81f3964a82d8 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:14.951938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7f882-228b-488f-9776-81f3964a82d8 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:14.957490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98734368-2b75-4481-b698-3c126b09a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:14.958433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98734368-2b75-4481-b698-3c126b09a5df admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.959082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98734368-2b75-4481-b698-3c126b09a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.959082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98734368-2b75-4481-b698-3c126b09a5df admin admin] PATH_INFO: `/v3/projects/2f5727a094a84f4e9b57581c4f141f6f/users/375b52538b3f4a5995ab164860b1a934/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:14.961224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98734368-2b75-4481-b698-3c126b09a5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5727a094a84f4e9b57581c4f141f6f, user_id=375b52538b3f4a5995ab164860b1a934, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:14.964258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98734368-2b75-4481-b698-3c126b09a5df admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:14.975703 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1388/2785] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:14 2022] PUT /identity/v3/projects/2f5727a094a84f4e9b57581c4f141f6f/users/375b52538b3f4a5995ab164860b1a934/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:14.987558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a485e6-3b13-4f96-aa8b-42f62dd2dd9a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:14.987853 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a485e6-3b13-4f96-aa8b-42f62dd2dd9a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:14.988126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a485e6-3b13-4f96-aa8b-42f62dd2dd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:15.016534 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-40a485e6-3b13-4f96-aa8b-42f62dd2dd9a None None] MFA Rules not processed for user `375b52538b3f4a5995ab164860b1a934`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:15.017788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-40a485e6-3b13-4f96-aa8b-42f62dd2dd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:15.089697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1398/2786] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:15.101677 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98734368-2b75-4481-b698-3c126b09a5df admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:15.103526 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-98734368-2b75-4481-b698-3c126b09a5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:15.165329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98734368-2b75-4481-b698-3c126b09a5df admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:15.169755 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84667e6d-6e7f-4768-8c6b-95cd96c00aeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:15.170480 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667e6d-6e7f-4768-8c6b-95cd96c00aeb service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:15.170767 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667e6d-6e7f-4768-8c6b-95cd96c00aeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:15.171039 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84667e6d-6e7f-4768-8c6b-95cd96c00aeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:15.181331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84667e6d-6e7f-4768-8c6b-95cd96c00aeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:15.182872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84667e6d-6e7f-4768-8c6b-95cd96c00aeb service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:15.193108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1389/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:15.257739 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a485e6-3b13-4f96-aa8b-42f62dd2dd9a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:15.322822 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a485e6-3b13-4f96-aa8b-42f62dd2dd9a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:15.328250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:15.329251 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:15.329539 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:15.329780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] PATH_INFO: `/v3/users/b93debd6a43741c7aad3f4c3dbb4420d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:15.331088 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93debd6a43741c7aad3f4c3dbb4420d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:15.333021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:15.334556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:15.382134 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93debd6a43741c7aad3f4c3dbb4420d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:15.382819 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93debd6a43741c7aad3f4c3dbb4420d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:15.391444 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93debd6a43741c7aad3f4c3dbb4420d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:15.404819 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93debd6a43741c7aad3f4c3dbb4420d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:15.412685 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93debd6a43741c7aad3f4c3dbb4420d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:15.419313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1399/2788] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:15 2022] DELETE /identity/v3/users/b93debd6a43741c7aad3f4c3dbb4420d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:15.424244 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758952e2-bb9e-4ed4-a258-66764c008a1a None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:15.424536 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758952e2-bb9e-4ed4-a258-66764c008a1a None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:15.424814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758952e2-bb9e-4ed4-a258-66764c008a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:15.443655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-758952e2-bb9e-4ed4-a258-66764c008a1a None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:15.444974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-758952e2-bb9e-4ed4-a258-66764c008a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:15.508989 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1390/2789] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:15.519186 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:15.520780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:15.579753 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bb56f-cb57-4db6-b192-3a91262bd05a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:15.584125 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d048e-75bd-46ba-8d8e-086e311f22ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:15.584784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d048e-75bd-46ba-8d8e-086e311f22ff service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:15.585067 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d048e-75bd-46ba-8d8e-086e311f22ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:15.585338 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d048e-75bd-46ba-8d8e-086e311f22ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:15.596049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d048e-75bd-46ba-8d8e-086e311f22ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:15.597496 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d048e-75bd-46ba-8d8e-086e311f22ff service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:15.607396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1400/2790] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:15.887803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758952e2-bb9e-4ed4-a258-66764c008a1a None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:15.889371 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-758952e2-bb9e-4ed4-a258-66764c008a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:15.901618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758952e2-bb9e-4ed4-a258-66764c008a1a None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:15.906611 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:15.908349 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:15.908692 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:15.908973 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] PATH_INFO: `/v3/projects/35d743bb309942a6be7a996c4a02d700` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:15.910258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d743bb309942a6be7a996c4a02d700)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:15.912237 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:15.967512 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:15.968754 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d743bb309942a6be7a996c4a02d700', 'request_id': 'req-6a4dab0f-9a8b-4951-8ab9-160941add8c2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:15.976728 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d743bb309942a6be7a996c4a02d700', 'request_id': 'req-6a4dab0f-9a8b-4951-8ab9-160941add8c2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:15.986195 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d743bb309942a6be7a996c4a02d700', 'request_id': 'req-6a4dab0f-9a8b-4951-8ab9-160941add8c2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:15.997529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] The token cache is being invalidate because project 35d743bb309942a6be7a996c4a02d700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:15.997812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:15.998487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:16.000227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1391/2791] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:15 2022] DELETE /identity/v3/projects/35d743bb309942a6be7a996c4a02d700 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:16.004583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d048e-75bd-46ba-8d8e-086e311f22ff service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:16.014697 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d048e-75bd-46ba-8d8e-086e311f22ff service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:16.079869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0922fde-96b3-4466-a2f7-d4efa006b146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:16.080756 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0922fde-96b3-4466-a2f7-d4efa006b146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:16.081034 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0922fde-96b3-4466-a2f7-d4efa006b146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:16.081302 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0922fde-96b3-4466-a2f7-d4efa006b146 admin admin] PATH_INFO: `/v3/users/375b52538b3f4a5995ab164860b1a934` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:16.082527 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0922fde-96b3-4466-a2f7-d4efa006b146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=375b52538b3f4a5995ab164860b1a934)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:16.084513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0922fde-96b3-4466-a2f7-d4efa006b146 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:16.107333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:16.134863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c0922fde-96b3-4466-a2f7-d4efa006b146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375b52538b3f4a5995ab164860b1a934'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:16.135487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c0922fde-96b3-4466-a2f7-d4efa006b146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375b52538b3f4a5995ab164860b1a934'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:16.144407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c0922fde-96b3-4466-a2f7-d4efa006b146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375b52538b3f4a5995ab164860b1a934'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:16.158529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c0922fde-96b3-4466-a2f7-d4efa006b146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375b52538b3f4a5995ab164860b1a934'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:16.165920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c0922fde-96b3-4466-a2f7-d4efa006b146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375b52538b3f4a5995ab164860b1a934'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:16.172036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1401/2792] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:16 2022] DELETE /identity/v3/users/375b52538b3f4a5995ab164860b1a934 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:16.459951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:16.461418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:16.475978 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dab0f-9a8b-4951-8ab9-160941add8c2 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:16.533302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:16.534107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:16.534414 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:16.534686 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] PATH_INFO: `/v3/projects/2f5727a094a84f4e9b57581c4f141f6f` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:16.535853 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5727a094a84f4e9b57581c4f141f6f)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:16.537762 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:16.587922 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5727a094a84f4e9b57581c4f141f6f', 'request_id': 'req-80002b24-4049-4503-8b7c-cc4ec2a53472'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:16.594815 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5727a094a84f4e9b57581c4f141f6f', 'request_id': 'req-80002b24-4049-4503-8b7c-cc4ec2a53472'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:16.603310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5727a094a84f4e9b57581c4f141f6f', 'request_id': 'req-80002b24-4049-4503-8b7c-cc4ec2a53472'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:16.613796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] The token cache is being invalidate because project 2f5727a094a84f4e9b57581c4f141f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:16.614077 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:16.614719 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-80002b24-4049-4503-8b7c-cc4ec2a53472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:16.616274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1392/2793] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:16 2022] DELETE /identity/v3/projects/2f5727a094a84f4e9b57581c4f141f6f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:16.621296 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe096f7-9894-41eb-b575-dd8797144204 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:16.621826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe096f7-9894-41eb-b575-dd8797144204 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:16.621826 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe096f7-9894-41eb-b575-dd8797144204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:16.640155 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ffe096f7-9894-41eb-b575-dd8797144204 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:16.641618 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ffe096f7-9894-41eb-b575-dd8797144204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:16.701699 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1402/2794] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:16.711965 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c425-fd94-469d-82c1-bfce4017b2e5 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:16.712482 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c425-fd94-469d-82c1-bfce4017b2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:16.712975 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c425-fd94-469d-82c1-bfce4017b2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:16.740129 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-8326c425-fd94-469d-82c1-bfce4017b2e5 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:16.741338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-8326c425-fd94-469d-82c1-bfce4017b2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:16.750814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1393/2795] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:16.755282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe096f7-9894-41eb-b575-dd8797144204 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:16.766144 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe096f7-9894-41eb-b575-dd8797144204 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:16.771850 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654fb49-bb8e-439b-a5e2-32f80a4bf4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:16.772639 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654fb49-bb8e-439b-a5e2-32f80a4bf4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:16.772925 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654fb49-bb8e-439b-a5e2-32f80a4bf4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:16.773200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654fb49-bb8e-439b-a5e2-32f80a4bf4dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:16.773936 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654fb49-bb8e-439b-a5e2-32f80a4bf4dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:25:16.774246 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654fb49-bb8e-439b-a5e2-32f80a4bf4dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:16.775909 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654fb49-bb8e-439b-a5e2-32f80a4bf4dd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:16.788497 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1403/2796] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 03:25:16.792849 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c425-fd94-469d-82c1-bfce4017b2e5 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:16.802361 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c425-fd94-469d-82c1-bfce4017b2e5 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:16.807618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5437ca-9c7e-4184-908a-86ea38caad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:16.808270 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5437ca-9c7e-4184-908a-86ea38caad01 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:16.808545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5437ca-9c7e-4184-908a-86ea38caad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:16.808812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5437ca-9c7e-4184-908a-86ea38caad01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:16.809510 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5437ca-9c7e-4184-908a-86ea38caad01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:16.811456 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5437ca-9c7e-4184-908a-86ea38caad01 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:16.845044 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1394/2797] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:25:16 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:25:16.847158 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654fb49-bb8e-439b-a5e2-32f80a4bf4dd admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:16.863223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654fb49-bb8e-439b-a5e2-32f80a4bf4dd admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:16.925438 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9102aa1-e545-4fb4-b970-2d35543fd110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:16.926129 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9102aa1-e545-4fb4-b970-2d35543fd110 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:16.926440 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9102aa1-e545-4fb4-b970-2d35543fd110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:16.926711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9102aa1-e545-4fb4-b970-2d35543fd110 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:16.927396 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9102aa1-e545-4fb4-b970-2d35543fd110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:16.929299 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9102aa1-e545-4fb4-b970-2d35543fd110 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:16.952515 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1404/2798] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:25:16 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:16.953608 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5437ca-9c7e-4184-908a-86ea38caad01 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:16.965400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5437ca-9c7e-4184-908a-86ea38caad01 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:16.970599 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b960924-5cc5-455c-8a24-577d38280f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:16.971290 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960924-5cc5-455c-8a24-577d38280f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:16.971758 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960924-5cc5-455c-8a24-577d38280f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:16.972086 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960924-5cc5-455c-8a24-577d38280f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:16.972828 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b960924-5cc5-455c-8a24-577d38280f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:16.974529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b960924-5cc5-455c-8a24-577d38280f80 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:16.986760 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1395/2799] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:16.990974 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9102aa1-e545-4fb4-b970-2d35543fd110 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:17.002937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9102aa1-e545-4fb4-b970-2d35543fd110 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:17.007477 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b9b09-ab0b-4f6c-93dc-2c61123c868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:17.008688 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b9b09-ab0b-4f6c-93dc-2c61123c868f admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:17.008973 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b9b09-ab0b-4f6c-93dc-2c61123c868f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:17.009274 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b9b09-ab0b-4f6c-93dc-2c61123c868f admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:17.010011 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b9b09-ab0b-4f6c-93dc-2c61123c868f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:17.011662 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b9b09-ab0b-4f6c-93dc-2c61123c868f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:17.022557 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1405/2800] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:17.028498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b960924-5cc5-455c-8a24-577d38280f80 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:17.039241 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b960924-5cc5-455c-8a24-577d38280f80 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:17.044428 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ca479-7f21-4bd6-9a46-61bdf79e1ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:17.045321 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca479-7f21-4bd6-9a46-61bdf79e1ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:17.045628 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca479-7f21-4bd6-9a46-61bdf79e1ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:17.045902 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca479-7f21-4bd6-9a46-61bdf79e1ff2 admin admin] PATH_INFO: `/v3/projects/ced14e93077a4ec5a4a405546206140b/users/f9798a6d6d57420eabfae6468075cde7/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:17.062496 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ca479-7f21-4bd6-9a46-61bdf79e1ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced14e93077a4ec5a4a405546206140b, user_id=f9798a6d6d57420eabfae6468075cde7, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:17.065679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ca479-7f21-4bd6-9a46-61bdf79e1ff2 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:17.080019 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1396/2801] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:17 2022] PUT /identity/v3/projects/ced14e93077a4ec5a4a405546206140b/users/f9798a6d6d57420eabfae6468075cde7/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:17.091683 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33efb-894b-48f1-80c4-12ea400eaa71 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:17.092066 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33efb-894b-48f1-80c4-12ea400eaa71 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:17.092438 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33efb-894b-48f1-80c4-12ea400eaa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:17.107113 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:17.125870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9ae33efb-894b-48f1-80c4-12ea400eaa71 None None] MFA Rules not processed for user `f9798a6d6d57420eabfae6468075cde7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:17.127267 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9ae33efb-894b-48f1-80c4-12ea400eaa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:17.199651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1406/2802] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:17.204418 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ca479-7f21-4bd6-9a46-61bdf79e1ff2 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:17.209009 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:17.278216 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ca479-7f21-4bd6-9a46-61bdf79e1ff2 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:17.283908 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a453ed-e043-44a8-882c-2356b05d82ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:17.284606 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a453ed-e043-44a8-882c-2356b05d82ad admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:17.284890 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a453ed-e043-44a8-882c-2356b05d82ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:17.285300 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a453ed-e043-44a8-882c-2356b05d82ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:17.286004 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a453ed-e043-44a8-882c-2356b05d82ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:17.287967 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a453ed-e043-44a8-882c-2356b05d82ad admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:17.317055 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1397/2803] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:25:17 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:17.320223 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae33efb-894b-48f1-80c4-12ea400eaa71 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:17.331614 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae33efb-894b-48f1-80c4-12ea400eaa71 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:17.395824 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a6e5a-e555-4434-8aab-cd157330862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:17.396504 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a6e5a-e555-4434-8aab-cd157330862a admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:17.396779 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a6e5a-e555-4434-8aab-cd157330862a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:17.397051 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a6e5a-e555-4434-8aab-cd157330862a admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:17.397747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a6e5a-e555-4434-8aab-cd157330862a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:17.399700 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a6e5a-e555-4434-8aab-cd157330862a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:17.423512 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1407/2804] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:25:17 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:17.427886 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a453ed-e043-44a8-882c-2356b05d82ad admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:17.439016 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a453ed-e043-44a8-882c-2356b05d82ad admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:17.443561 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538b31-ed01-4a22-8e31-661809dbc57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:17.444223 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538b31-ed01-4a22-8e31-661809dbc57b admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:17.444498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538b31-ed01-4a22-8e31-661809dbc57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:17.444768 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538b31-ed01-4a22-8e31-661809dbc57b admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:17.445495 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1538b31-ed01-4a22-8e31-661809dbc57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:17.447132 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1538b31-ed01-4a22-8e31-661809dbc57b admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:17.458285 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1398/2805] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:17.463376 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a6e5a-e555-4434-8aab-cd157330862a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:17.479249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a6e5a-e555-4434-8aab-cd157330862a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:17.488300 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936ff44-9d4f-4d5c-b5e2-afb7d4697113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:17.489747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936ff44-9d4f-4d5c-b5e2-afb7d4697113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:17.490126 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936ff44-9d4f-4d5c-b5e2-afb7d4697113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:17.490583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936ff44-9d4f-4d5c-b5e2-afb7d4697113 admin admin] PATH_INFO: `/v3/projects/f603e4c573f241088d1dc10a720492dd/users/165b79e87499403c8506b711628b44a4/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:17.514976 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936ff44-9d4f-4d5c-b5e2-afb7d4697113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f603e4c573f241088d1dc10a720492dd, user_id=165b79e87499403c8506b711628b44a4, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:17.518671 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936ff44-9d4f-4d5c-b5e2-afb7d4697113 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:17.535382 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1408/2806] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:17 2022] PUT /identity/v3/projects/f603e4c573f241088d1dc10a720492dd/users/165b79e87499403c8506b711628b44a4/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:17.541410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538b31-ed01-4a22-8e31-661809dbc57b admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:17.554593 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538b31-ed01-4a22-8e31-661809dbc57b admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:17.613351 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fdccf-9671-4bb8-881a-2ff638e1e8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:17.614017 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fdccf-9671-4bb8-881a-2ff638e1e8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:17.614333 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fdccf-9671-4bb8-881a-2ff638e1e8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:17.614613 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fdccf-9671-4bb8-881a-2ff638e1e8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:17.615329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fdccf-9671-4bb8-881a-2ff638e1e8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:17.616911 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fdccf-9671-4bb8-881a-2ff638e1e8d7 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:17.626782 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1399/2807] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:17.631253 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936ff44-9d4f-4d5c-b5e2-afb7d4697113 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:17.641644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936ff44-9d4f-4d5c-b5e2-afb7d4697113 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:17.646489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8196-18eb-43b1-8b8c-72f443559d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:17.647375 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8196-18eb-43b1-8b8c-72f443559d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:17.647649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8196-18eb-43b1-8b8c-72f443559d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:17.647908 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8196-18eb-43b1-8b8c-72f443559d18 admin admin] PATH_INFO: `/v3/projects/f603e4c573f241088d1dc10a720492dd/users/165b79e87499403c8506b711628b44a4/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:17.649962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db8196-18eb-43b1-8b8c-72f443559d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f603e4c573f241088d1dc10a720492dd, user_id=165b79e87499403c8506b711628b44a4, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:17.652737 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db8196-18eb-43b1-8b8c-72f443559d18 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:17.663282 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1409/2808] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:17 2022] PUT /identity/v3/projects/f603e4c573f241088d1dc10a720492dd/users/165b79e87499403c8506b711628b44a4/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:17.674847 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7268f6-82a2-4d03-8cc3-00d7bca9bd07 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:17.675147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7268f6-82a2-4d03-8cc3-00d7bca9bd07 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:17.675423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7268f6-82a2-4d03-8cc3-00d7bca9bd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:17.703159 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-ee7268f6-82a2-4d03-8cc3-00d7bca9bd07 None None] MFA Rules not processed for user `165b79e87499403c8506b711628b44a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:17.704488 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ee7268f6-82a2-4d03-8cc3-00d7bca9bd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:17.794924 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:17.801450 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1400/2809] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:17.812622 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8196-18eb-43b1-8b8c-72f443559d18 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:17.814827 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d4db8196-18eb-43b1-8b8c-72f443559d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:17.882023 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:17.886393 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8196-18eb-43b1-8b8c-72f443559d18 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:17.892212 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e7dff-15ef-41a5-bcf6-55a75e1c22cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:17.892888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e7dff-15ef-41a5-bcf6-55a75e1c22cc service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:17.893168 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e7dff-15ef-41a5-bcf6-55a75e1c22cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:17.893441 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e7dff-15ef-41a5-bcf6-55a75e1c22cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:17.903565 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e7dff-15ef-41a5-bcf6-55a75e1c22cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:17.905012 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e7dff-15ef-41a5-bcf6-55a75e1c22cc service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:17.914944 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1410/2810] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:18.015878 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7268f6-82a2-4d03-8cc3-00d7bca9bd07 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:18.017707 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ee7268f6-82a2-4d03-8cc3-00d7bca9bd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:18.030887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7268f6-82a2-4d03-8cc3-00d7bca9bd07 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:18.034940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde2217-f5ce-4986-b880-d43e083b8a6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:18.035596 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2217-f5ce-4986-b880-d43e083b8a6e service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:18.035921 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2217-f5ce-4986-b880-d43e083b8a6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:18.036135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2217-f5ce-4986-b880-d43e083b8a6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:18.103655 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde2217-f5ce-4986-b880-d43e083b8a6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:18.105115 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde2217-f5ce-4986-b880-d43e083b8a6e service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:18.116796 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1401/2811] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:20.720078 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e7dff-15ef-41a5-bcf6-55a75e1c22cc service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:20.790684 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e7dff-15ef-41a5-bcf6-55a75e1c22cc service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:20.797558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:20.799055 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:20.799560 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:20.800024 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] PATH_INFO: `/v3/users/f9798a6d6d57420eabfae6468075cde7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:20.802007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9798a6d6d57420eabfae6468075cde7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:20.804901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:20.861300 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9798a6d6d57420eabfae6468075cde7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:20.862407 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9798a6d6d57420eabfae6468075cde7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:20.872368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9798a6d6d57420eabfae6468075cde7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:20.885928 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9798a6d6d57420eabfae6468075cde7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:20.893426 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9798a6d6d57420eabfae6468075cde7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:20.899721 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1411/2812] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:20 2022] DELETE /identity/v3/users/f9798a6d6d57420eabfae6468075cde7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:20.904329 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec5f6a-c893-47b8-8969-dfcdb080a73b None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:20.904835 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec5f6a-c893-47b8-8969-dfcdb080a73b None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:20.904938 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec5f6a-c893-47b8-8969-dfcdb080a73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:20.923867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6aec5f6a-c893-47b8-8969-dfcdb080a73b None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:20.925720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6aec5f6a-c893-47b8-8969-dfcdb080a73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:20.991433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1402/2813] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:21.002125 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:21.003941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:21.014000 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec5f6a-c893-47b8-8969-dfcdb080a73b None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:21.016108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6aec5f6a-c893-47b8-8969-dfcdb080a73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:21.033434 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec5f6a-c893-47b8-8969-dfcdb080a73b None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:21.038621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:21.039528 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:21.039809 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:21.040082 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] PATH_INFO: `/v3/users/8f3f0264d71f49ff98d477bdfacf530d` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:21.041298 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3f0264d71f49ff98d477bdfacf530d)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:21.043790 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:21.066336 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a163b-b042-476e-9870-7857a00b1ef8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:21.070227 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3715451-5910-42b5-852c-2d6a7bd78a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:21.070911 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3715451-5910-42b5-852c-2d6a7bd78a56 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:21.071570 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3715451-5910-42b5-852c-2d6a7bd78a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:21.071570 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3715451-5910-42b5-852c-2d6a7bd78a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:21.082123 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3715451-5910-42b5-852c-2d6a7bd78a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:21.083838 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3715451-5910-42b5-852c-2d6a7bd78a56 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:21.093798 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1412/2814] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 03:25:21.097633 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3f0264d71f49ff98d477bdfacf530d'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.098331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3f0264d71f49ff98d477bdfacf530d'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.105506 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3f0264d71f49ff98d477bdfacf530d'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.113665 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3f0264d71f49ff98d477bdfacf530d'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.126510 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3f0264d71f49ff98d477bdfacf530d'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.133112 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1403/2815] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:21 2022] DELETE /identity/v3/users/8f3f0264d71f49ff98d477bdfacf530d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:25:21.370138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3715451-5910-42b5-852c-2d6a7bd78a56 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:21.381249 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3715451-5910-42b5-852c-2d6a7bd78a56 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:21.393480 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:21.428581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:21.430282 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:21.444373 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:21.459178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:21.460176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:21.460517 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:21.460992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] PATH_INFO: `/v3/projects/5a17a0e81c104e17a27a21e66952f1bd` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:21.462279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a17a0e81c104e17a27a21e66952f1bd)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:21.464830 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:21.502618 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef6ca6-6fa9-49bd-8783-08a52dfb7075 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:21.512709 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a17a0e81c104e17a27a21e66952f1bd', 'request_id': 'req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.519307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a17a0e81c104e17a27a21e66952f1bd', 'request_id': 'req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.528463 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a17a0e81c104e17a27a21e66952f1bd', 'request_id': 'req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.540232 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] The token cache is being invalidate because project 5a17a0e81c104e17a27a21e66952f1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:21.540513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.541140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.542728 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1413/2816] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:21 2022] DELETE /identity/v3/projects/5a17a0e81c104e17a27a21e66952f1bd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:21.561867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:21.562828 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:21.563109 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:21.563379 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] PATH_INFO: `/v3/projects/ced14e93077a4ec5a4a405546206140b` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:21.564747 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced14e93077a4ec5a4a405546206140b)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:21.566834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:21.620727 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced14e93077a4ec5a4a405546206140b', 'request_id': 'req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.628337 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced14e93077a4ec5a4a405546206140b', 'request_id': 'req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.638210 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced14e93077a4ec5a4a405546206140b', 'request_id': 'req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.651215 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] The token cache is being invalidate because project ced14e93077a4ec5a4a405546206140b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:21.651500 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.652236 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.653937 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1404/2817] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:21 2022] DELETE /identity/v3/projects/ced14e93077a4ec5a4a405546206140b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:21.658170 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:21.659783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:21.673399 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c751b-f665-4e7a-a5cb-22d780bb3dc9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:21.741354 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75242f7-f06d-49c8-bc2b-468bdc75acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:21.742271 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75242f7-f06d-49c8-bc2b-468bdc75acc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:21.742582 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75242f7-f06d-49c8-bc2b-468bdc75acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:21.742863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75242f7-f06d-49c8-bc2b-468bdc75acc8 admin admin] PATH_INFO: `/v3/users/165b79e87499403c8506b711628b44a4` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:21.744304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75242f7-f06d-49c8-bc2b-468bdc75acc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=165b79e87499403c8506b711628b44a4)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:21.746330 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75242f7-f06d-49c8-bc2b-468bdc75acc8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:21.796816 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:21.798310 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a75242f7-f06d-49c8-bc2b-468bdc75acc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165b79e87499403c8506b711628b44a4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.798977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a75242f7-f06d-49c8-bc2b-468bdc75acc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165b79e87499403c8506b711628b44a4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.807862 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a75242f7-f06d-49c8-bc2b-468bdc75acc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165b79e87499403c8506b711628b44a4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.820105 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a75242f7-f06d-49c8-bc2b-468bdc75acc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165b79e87499403c8506b711628b44a4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.827669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a75242f7-f06d-49c8-bc2b-468bdc75acc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165b79e87499403c8506b711628b44a4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:21.834644 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1414/2818] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:21 2022] DELETE /identity/v3/users/165b79e87499403c8506b711628b44a4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:22.120247 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:22.122228 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:22.135221 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b906c6-f2b1-4ff4-8f95-c9d3bbe2813a admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:22.183199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:22.197922 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:22.198855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:22.199135 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:22.199408 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] PATH_INFO: `/v3/projects/f603e4c573f241088d1dc10a720492dd` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:22.200624 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f603e4c573f241088d1dc10a720492dd)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:22.202609 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:22.251621 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f603e4c573f241088d1dc10a720492dd', 'request_id': 'req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:22.258318 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f603e4c573f241088d1dc10a720492dd', 'request_id': 'req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:22.267856 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f603e4c573f241088d1dc10a720492dd', 'request_id': 'req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:22.278700 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] The token cache is being invalidate because project f603e4c573f241088d1dc10a720492dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:22.278988 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:22.279610 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ba8aca91-adbc-474a-af41-0fcfd4a7b8d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:22.281164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1405/2819] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:22 2022] DELETE /identity/v3/projects/f603e4c573f241088d1dc10a720492dd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:22.286563 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b42ed-b804-46d5-bc7c-56c68fc18bf2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:22.286847 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b42ed-b804-46d5-bc7c-56c68fc18bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:22.287120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b42ed-b804-46d5-bc7c-56c68fc18bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:22.306895 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-712b42ed-b804-46d5-bc7c-56c68fc18bf2 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:22.308009 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-712b42ed-b804-46d5-bc7c-56c68fc18bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:22.371937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1415/2820] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:22.380224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09bec-75fb-496b-a96c-a6a912e7d3c4 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:22.380512 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09bec-75fb-496b-a96c-a6a912e7d3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:22.380786 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09bec-75fb-496b-a96c-a6a912e7d3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:22.401754 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-f1c09bec-75fb-496b-a96c-a6a912e7d3c4 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:22.402981 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-f1c09bec-75fb-496b-a96c-a6a912e7d3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:22.412855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1406/2821] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:22.417371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b42ed-b804-46d5-bc7c-56c68fc18bf2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:22.427741 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b42ed-b804-46d5-bc7c-56c68fc18bf2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:22.433516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb6af2-9cb1-446b-9852-79d533d3c7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:22.434200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb6af2-9cb1-446b-9852-79d533d3c7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:22.434492 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb6af2-9cb1-446b-9852-79d533d3c7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:22.434775 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb6af2-9cb1-446b-9852-79d533d3c7b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:22.435510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb6af2-9cb1-446b-9852-79d533d3c7b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:25:22.435819 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb6af2-9cb1-446b-9852-79d533d3c7b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:22.437500 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb6af2-9cb1-446b-9852-79d533d3c7b4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:22.450109 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1416/2822] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:25:22.454622 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c09bec-75fb-496b-a96c-a6a912e7d3c4 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:22.464415 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c09bec-75fb-496b-a96c-a6a912e7d3c4 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:22.469524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef91cf-d1fa-4cea-b016-527fefd4d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:22.470170 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef91cf-d1fa-4cea-b016-527fefd4d08f admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:22.470469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef91cf-d1fa-4cea-b016-527fefd4d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:22.470737 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef91cf-d1fa-4cea-b016-527fefd4d08f admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:22.471413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef91cf-d1fa-4cea-b016-527fefd4d08f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:22.473438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef91cf-d1fa-4cea-b016-527fefd4d08f admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:22.503692 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1407/2823] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:25:22 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:25:22.508085 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb6af2-9cb1-446b-9852-79d533d3c7b4 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:22.518725 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb6af2-9cb1-446b-9852-79d533d3c7b4 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:22.576133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61ce54-a237-4cd0-8a05-67434d405405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:22.576727 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ce54-a237-4cd0-8a05-67434d405405 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:22.577007 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ce54-a237-4cd0-8a05-67434d405405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:22.577278 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ce54-a237-4cd0-8a05-67434d405405 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:22.577959 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61ce54-a237-4cd0-8a05-67434d405405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:22.579921 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61ce54-a237-4cd0-8a05-67434d405405 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:22.602246 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1417/2824] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:25:22 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:22.606769 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef91cf-d1fa-4cea-b016-527fefd4d08f admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:22.617791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef91cf-d1fa-4cea-b016-527fefd4d08f admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:22.622518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f7fa0-af9e-4d53-aae9-da3654287020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:22.623175 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7fa0-af9e-4d53-aae9-da3654287020 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:22.623452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7fa0-af9e-4d53-aae9-da3654287020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:22.623720 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7fa0-af9e-4d53-aae9-da3654287020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:22.624444 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f7fa0-af9e-4d53-aae9-da3654287020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:22.626047 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f7fa0-af9e-4d53-aae9-da3654287020 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:22.637731 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1408/2825] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:22.643371 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61ce54-a237-4cd0-8a05-67434d405405 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:22.654648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61ce54-a237-4cd0-8a05-67434d405405 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:22.660783 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0af183-2527-4694-88e8-2438986dd7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:22.661445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af183-2527-4694-88e8-2438986dd7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:22.661717 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af183-2527-4694-88e8-2438986dd7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:22.661989 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af183-2527-4694-88e8-2438986dd7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:22.662767 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0af183-2527-4694-88e8-2438986dd7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:22.664361 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0af183-2527-4694-88e8-2438986dd7f4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:22.677895 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1418/2826] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:22.682310 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f7fa0-af9e-4d53-aae9-da3654287020 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:22.693278 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f7fa0-af9e-4d53-aae9-da3654287020 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:22.699075 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d9211-36ab-4aef-b6f9-fde211ca2731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:22.700068 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d9211-36ab-4aef-b6f9-fde211ca2731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:22.700433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d9211-36ab-4aef-b6f9-fde211ca2731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:22.700759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d9211-36ab-4aef-b6f9-fde211ca2731 admin admin] PATH_INFO: `/v3/projects/173bb424cca145fabe4d30bde9354bb1/users/f73d4e36e736444e86c98a08c75d4c35/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:22.716679 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d9211-36ab-4aef-b6f9-fde211ca2731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173bb424cca145fabe4d30bde9354bb1, user_id=f73d4e36e736444e86c98a08c75d4c35, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:22.719438 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d9211-36ab-4aef-b6f9-fde211ca2731 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:22.734607 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1409/2827] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:22 2022] PUT /identity/v3/projects/173bb424cca145fabe4d30bde9354bb1/users/f73d4e36e736444e86c98a08c75d4c35/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:22.745558 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca803296-7a68-4c78-8881-b41ff9359efb None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:22.746049 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca803296-7a68-4c78-8881-b41ff9359efb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:22.746150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca803296-7a68-4c78-8881-b41ff9359efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:22.774276 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ca803296-7a68-4c78-8881-b41ff9359efb None None] MFA Rules not processed for user `f73d4e36e736444e86c98a08c75d4c35`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:22.775521 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ca803296-7a68-4c78-8881-b41ff9359efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:22.792809 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:22.842781 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1419/2828] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:22.847597 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d9211-36ab-4aef-b6f9-fde211ca2731 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:22.913196 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d9211-36ab-4aef-b6f9-fde211ca2731 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:22.919274 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc30226-0302-4064-a6bf-a92e87b0376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:22.919940 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc30226-0302-4064-a6bf-a92e87b0376c admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:22.920224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc30226-0302-4064-a6bf-a92e87b0376c admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:22.920502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc30226-0302-4064-a6bf-a92e87b0376c admin admin] PATH_INFO: `/v3/projects` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:22.921205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc30226-0302-4064-a6bf-a92e87b0376c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:22.923163 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc30226-0302-4064-a6bf-a92e87b0376c admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:22.945074 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:22.953277 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1410/2829] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:25:22 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:22.957633 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca803296-7a68-4c78-8881-b41ff9359efb None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:22.969060 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca803296-7a68-4c78-8881-b41ff9359efb None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:23.027231 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3649149-2b96-4d8a-8706-2e19a7da38f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:23.027892 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649149-2b96-4d8a-8706-2e19a7da38f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:23.028178 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649149-2b96-4d8a-8706-2e19a7da38f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:23.028450 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649149-2b96-4d8a-8706-2e19a7da38f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:23.029132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3649149-2b96-4d8a-8706-2e19a7da38f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:23.031087 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3649149-2b96-4d8a-8706-2e19a7da38f0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:23.058238 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1420/2830] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:25:22 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:23.059691 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc30226-0302-4064-a6bf-a92e87b0376c admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:23.070753 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc30226-0302-4064-a6bf-a92e87b0376c admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:23.075477 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff3716-cff4-424a-9fef-522a314ba235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:23.076143 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff3716-cff4-424a-9fef-522a314ba235 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:23.076420 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff3716-cff4-424a-9fef-522a314ba235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:23.076688 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff3716-cff4-424a-9fef-522a314ba235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:23.077413 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff3716-cff4-424a-9fef-522a314ba235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:23.079050 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff3716-cff4-424a-9fef-522a314ba235 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:23.089869 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1411/2831] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:23.094436 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3649149-2b96-4d8a-8706-2e19a7da38f0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:23.105064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3649149-2b96-4d8a-8706-2e19a7da38f0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:23.109948 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5a6fb-e275-4c64-9bc0-bc9f575c7e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:23.110930 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5a6fb-e275-4c64-9bc0-bc9f575c7e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:23.111211 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5a6fb-e275-4c64-9bc0-bc9f575c7e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:23.111493 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5a6fb-e275-4c64-9bc0-bc9f575c7e58 admin admin] PATH_INFO: `/v3/projects/573b3f4fdddd4638a6be84162ed65aa6/users/66ebb0564a5240eba5feb4f76c8268eb/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:23.127530 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5a6fb-e275-4c64-9bc0-bc9f575c7e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573b3f4fdddd4638a6be84162ed65aa6, user_id=66ebb0564a5240eba5feb4f76c8268eb, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:23.130499 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5a6fb-e275-4c64-9bc0-bc9f575c7e58 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:23.146529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1421/2832] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:23 2022] PUT /identity/v3/projects/573b3f4fdddd4638a6be84162ed65aa6/users/66ebb0564a5240eba5feb4f76c8268eb/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:23.151181 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff3716-cff4-424a-9fef-522a314ba235 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:23.165073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff3716-cff4-424a-9fef-522a314ba235 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:23.235822 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02d5d8-5160-4cd7-b9af-a9b0974e4fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:23.236527 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02d5d8-5160-4cd7-b9af-a9b0974e4fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:23.236812 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02d5d8-5160-4cd7-b9af-a9b0974e4fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:23.237064 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02d5d8-5160-4cd7-b9af-a9b0974e4fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:23.237867 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02d5d8-5160-4cd7-b9af-a9b0974e4fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:23.239524 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02d5d8-5160-4cd7-b9af-a9b0974e4fc5 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:23.249946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1412/2833] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 03:25:23.254563 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5a6fb-e275-4c64-9bc0-bc9f575c7e58 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:23.265344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5a6fb-e275-4c64-9bc0-bc9f575c7e58 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:23.270389 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfaff6-3719-4e7b-bd83-2873207919a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:23.271285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfaff6-3719-4e7b-bd83-2873207919a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:23.271585 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfaff6-3719-4e7b-bd83-2873207919a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:23.271857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfaff6-3719-4e7b-bd83-2873207919a2 admin admin] PATH_INFO: `/v3/projects/573b3f4fdddd4638a6be84162ed65aa6/users/66ebb0564a5240eba5feb4f76c8268eb/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:23.273858 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfaff6-3719-4e7b-bd83-2873207919a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573b3f4fdddd4638a6be84162ed65aa6, user_id=66ebb0564a5240eba5feb4f76c8268eb, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:23.276529 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfaff6-3719-4e7b-bd83-2873207919a2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:23.287537 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1422/2834] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:23 2022] PUT /identity/v3/projects/573b3f4fdddd4638a6be84162ed65aa6/users/66ebb0564a5240eba5feb4f76c8268eb/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:23.299205 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0681525-3be9-4163-9f6b-161409e28bea None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:23.299502 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0681525-3be9-4163-9f6b-161409e28bea None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:23.299773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0681525-3be9-4163-9f6b-161409e28bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:23.328742 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-c0681525-3be9-4163-9f6b-161409e28bea None None] MFA Rules not processed for user `66ebb0564a5240eba5feb4f76c8268eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:23.329980 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-c0681525-3be9-4163-9f6b-161409e28bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:23.401647 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1413/2835] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:23.413041 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfaff6-3719-4e7b-bd83-2873207919a2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:23.414889 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-24cfaff6-3719-4e7b-bd83-2873207919a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:23.481646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfaff6-3719-4e7b-bd83-2873207919a2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:23.485752 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a4a88-f473-4c43-a18d-32e650fcbbaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:23.486435 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a4a88-f473-4c43-a18d-32e650fcbbaa service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:23.486696 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a4a88-f473-4c43-a18d-32e650fcbbaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:23.486970 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a4a88-f473-4c43-a18d-32e650fcbbaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:23.497189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a4a88-f473-4c43-a18d-32e650fcbbaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:23.498689 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a4a88-f473-4c43-a18d-32e650fcbbaa service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:23.508812 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1423/2836] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:23.639719 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0681525-3be9-4163-9f6b-161409e28bea None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:23.712200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0681525-3be9-4163-9f6b-161409e28bea None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:23.717355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:23.718543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:23.718817 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:23.719091 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] PATH_INFO: `/v3/users/f73d4e36e736444e86c98a08c75d4c35` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:23.720314 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73d4e36e736444e86c98a08c75d4c35)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:23.722400 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:23.734157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=100 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:23.775552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73d4e36e736444e86c98a08c75d4c35'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:23.776213 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73d4e36e736444e86c98a08c75d4c35'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:23.783158 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73d4e36e736444e86c98a08c75d4c35'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:23.791296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73d4e36e736444e86c98a08c75d4c35'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:23.804164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73d4e36e736444e86c98a08c75d4c35'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:23.810199 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1414/2837] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:23 2022] DELETE /identity/v3/users/f73d4e36e736444e86c98a08c75d4c35 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:23.814800 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842e1d-a8c3-40ed-8328-e847886793ef None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:23.815305 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842e1d-a8c3-40ed-8328-e847886793ef None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:23.815305 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842e1d-a8c3-40ed-8328-e847886793ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:23.834177 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-76842e1d-a8c3-40ed-8328-e847886793ef None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:23.835439 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-76842e1d-a8c3-40ed-8328-e847886793ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:23.844583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:23.899937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1424/2838] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:23.910669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:23.912961 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:23.981990 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ac94b-e650-46c1-b1cb-50daabcfc4be admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:23.986765 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75962893-815d-4ebe-ad55-59711447be75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:23.987433 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75962893-815d-4ebe-ad55-59711447be75 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:23.987733 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75962893-815d-4ebe-ad55-59711447be75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:23.988004 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75962893-815d-4ebe-ad55-59711447be75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:23.998490 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75962893-815d-4ebe-ad55-59711447be75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:23.999930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75962893-815d-4ebe-ad55-59711447be75 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:24.009891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1415/2839] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:24.295312 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76842e1d-a8c3-40ed-8328-e847886793ef None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:24.296830 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-76842e1d-a8c3-40ed-8328-e847886793ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:24.310138 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76842e1d-a8c3-40ed-8328-e847886793ef None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:24.316019 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:24.316735 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:24.317036 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:24.317354 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] PATH_INFO: `/v3/projects/173bb424cca145fabe4d30bde9354bb1` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:24.319132 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=173bb424cca145fabe4d30bde9354bb1)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:24.321079 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:24.371519 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173bb424cca145fabe4d30bde9354bb1', 'request_id': 'req-d29f6b6b-42a4-488d-82e2-7402ada91b42'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:24.377598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173bb424cca145fabe4d30bde9354bb1', 'request_id': 'req-d29f6b6b-42a4-488d-82e2-7402ada91b42'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:24.386907 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173bb424cca145fabe4d30bde9354bb1', 'request_id': 'req-d29f6b6b-42a4-488d-82e2-7402ada91b42'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:24.397796 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] The token cache is being invalidate because project 173bb424cca145fabe4d30bde9354bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:24.398084 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:24.398755 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:24.400334 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1425/2840] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:24 2022] DELETE /identity/v3/projects/173bb424cca145fabe4d30bde9354bb1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:24.404533 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75962893-815d-4ebe-ad55-59711447be75 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:24.414640 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75962893-815d-4ebe-ad55-59711447be75 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:24.453551 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:24.455611 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:24.476093 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b89f3-1b0a-425e-98d3-e38125b9fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:24.477011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b89f3-1b0a-425e-98d3-e38125b9fd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:24.477289 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b89f3-1b0a-425e-98d3-e38125b9fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:24.477559 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b89f3-1b0a-425e-98d3-e38125b9fd05 admin admin] PATH_INFO: `/v3/users/66ebb0564a5240eba5feb4f76c8268eb` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:24.478813 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b89f3-1b0a-425e-98d3-e38125b9fd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ebb0564a5240eba5feb4f76c8268eb)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:24.480734 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b89f3-1b0a-425e-98d3-e38125b9fd05 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:24.518423 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:24.531533 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f6b6b-42a4-488d-82e2-7402ada91b42 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:24.533820 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1a6b89f3-1b0a-425e-98d3-e38125b9fd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ebb0564a5240eba5feb4f76c8268eb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:24.534509 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1a6b89f3-1b0a-425e-98d3-e38125b9fd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ebb0564a5240eba5feb4f76c8268eb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:24.538115 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2742846-7ee7-4b58-af29-343682d592e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8048235c6421eae12ca99f80ed5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:24.538911 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742846-7ee7-4b58-af29-343682d592e0 service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:24.539188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742846-7ee7-4b58-af29-343682d592e0 service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:24.539456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742846-7ee7-4b58-af29-343682d592e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:24.541304 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f2742846-7ee7-4b58-af29-343682d592e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:24.542108 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1a6b89f3-1b0a-425e-98d3-e38125b9fd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ebb0564a5240eba5feb4f76c8268eb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:24.550011 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1a6b89f3-1b0a-425e-98d3-e38125b9fd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ebb0564a5240eba5feb4f76c8268eb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:24.553536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2742846-7ee7-4b58-af29-343682d592e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:24.555194 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2742846-7ee7-4b58-af29-343682d592e0 service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:24.562487 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-1a6b89f3-1b0a-425e-98d3-e38125b9fd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ebb0564a5240eba5feb4f76c8268eb'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:24.565604 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1426/2841] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:24.570046 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1416/2842] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:24 2022] DELETE /identity/v3/users/66ebb0564a5240eba5feb4f76c8268eb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:25.114487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2742846-7ee7-4b58-af29-343682d592e0 service placement] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:25.115987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f2742846-7ee7-4b58-af29-343682d592e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:25.130759 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2742846-7ee7-4b58-af29-343682d592e0 service placement] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:25.163577 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:25.198872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:25.199760 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:25.200038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:25.200307 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] PATH_INFO: `/v3/projects/573b3f4fdddd4638a6be84162ed65aa6` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:25.201550 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] RBAC: Authorizing `identity:delete_project(project_id=573b3f4fdddd4638a6be84162ed65aa6)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:25.203503 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:25.259457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573b3f4fdddd4638a6be84162ed65aa6', 'request_id': 'req-34dffe7f-6a1d-445c-bf64-955f9c07a95a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:25.265669 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573b3f4fdddd4638a6be84162ed65aa6', 'request_id': 'req-34dffe7f-6a1d-445c-bf64-955f9c07a95a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:25.275248 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573b3f4fdddd4638a6be84162ed65aa6', 'request_id': 'req-34dffe7f-6a1d-445c-bf64-955f9c07a95a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:25.290149 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] The token cache is being invalidate because project 573b3f4fdddd4638a6be84162ed65aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:25.290464 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:25.291163 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-34dffe7f-6a1d-445c-bf64-955f9c07a95a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:25.292811 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1427/2843] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:25 2022] DELETE /identity/v3/projects/573b3f4fdddd4638a6be84162ed65aa6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:25.297945 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777caf69-c843-48eb-9c99-b2417d523a7d None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:25.298230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777caf69-c843-48eb-9c99-b2417d523a7d None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:25.298532 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777caf69-c843-48eb-9c99-b2417d523a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:25.319656 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-777caf69-c843-48eb-9c99-b2417d523a7d None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:25.320572 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-777caf69-c843-48eb-9c99-b2417d523a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:25.381605 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1417/2844] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:25.389438 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151487-673b-434e-9afb-85540386809e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:25.389730 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151487-673b-434e-9afb-85540386809e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:25.389993 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151487-673b-434e-9afb-85540386809e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:25.409345 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c1151487-673b-434e-9afb-85540386809e None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:25.410663 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c1151487-673b-434e-9afb-85540386809e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:25.418793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1428/2845] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:25.422982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777caf69-c843-48eb-9c99-b2417d523a7d None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:25.433226 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777caf69-c843-48eb-9c99-b2417d523a7d None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:25.437917 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac1cc7-8734-488c-9526-e1c0636a4b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:25.438580 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1cc7-8734-488c-9526-e1c0636a4b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:25.438862 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1cc7-8734-488c-9526-e1c0636a4b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:25.439162 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1cc7-8734-488c-9526-e1c0636a4b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:25.439897 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac1cc7-8734-488c-9526-e1c0636a4b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:25:25.440200 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac1cc7-8734-488c-9526-e1c0636a4b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:25.441852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac1cc7-8734-488c-9526-e1c0636a4b4e admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:25.454468 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1418/2846] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:25:25.460782 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1151487-673b-434e-9afb-85540386809e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:25.474333 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1151487-673b-434e-9afb-85540386809e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:25.480247 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170e774-fa45-4180-9570-8b31e0ade79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:25.480901 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e774-fa45-4180-9570-8b31e0ade79c admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:25.481181 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e774-fa45-4180-9570-8b31e0ade79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:25.481452 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e774-fa45-4180-9570-8b31e0ade79c admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:25.482146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170e774-fa45-4180-9570-8b31e0ade79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:25.484107 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170e774-fa45-4180-9570-8b31e0ade79c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:25.513165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1429/2847] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:25:25 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:25.517648 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac1cc7-8734-488c-9526-e1c0636a4b4e admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:25.528291 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac1cc7-8734-488c-9526-e1c0636a4b4e admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:25.595696 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6b19e-a26f-467b-b32c-4913894462c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:25.596326 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b19e-a26f-467b-b32c-4913894462c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:25.596612 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b19e-a26f-467b-b32c-4913894462c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:25.596855 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b19e-a26f-467b-b32c-4913894462c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:25.597543 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6b19e-a26f-467b-b32c-4913894462c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:25.599738 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6b19e-a26f-467b-b32c-4913894462c6 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:25.621472 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1419/2848] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:25:25 2022] POST /identity/v3/users => generated 304 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:25.625825 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170e774-fa45-4180-9570-8b31e0ade79c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:25.636468 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170e774-fa45-4180-9570-8b31e0ade79c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:25.641623 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5584b26-3b7e-4cf5-a92a-af7ff5aac5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:25.642306 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5584b26-3b7e-4cf5-a92a-af7ff5aac5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:25.642619 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5584b26-3b7e-4cf5-a92a-af7ff5aac5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:25.642891 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5584b26-3b7e-4cf5-a92a-af7ff5aac5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:25.643624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5584b26-3b7e-4cf5-a92a-af7ff5aac5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:25.645340 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5584b26-3b7e-4cf5-a92a-af7ff5aac5c6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:25.656195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1430/2849] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:25.660306 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6b19e-a26f-467b-b32c-4913894462c6 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:25.670657 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6b19e-a26f-467b-b32c-4913894462c6 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:25.675352 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097875e-fd0e-46b3-8510-85877e6ab7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:25.676164 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097875e-fd0e-46b3-8510-85877e6ab7fb admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:25.676592 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097875e-fd0e-46b3-8510-85877e6ab7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:25.676735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097875e-fd0e-46b3-8510-85877e6ab7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:25.677476 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097875e-fd0e-46b3-8510-85877e6ab7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:25.679098 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097875e-fd0e-46b3-8510-85877e6ab7fb admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:25.689429 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1420/2850] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:25.693926 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5584b26-3b7e-4cf5-a92a-af7ff5aac5c6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:25.709597 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5584b26-3b7e-4cf5-a92a-af7ff5aac5c6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:25.715617 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059d9af-09da-4a69-8cdc-285aa1642fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:25.716510 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059d9af-09da-4a69-8cdc-285aa1642fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:25.716788 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059d9af-09da-4a69-8cdc-285aa1642fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:25.717061 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059d9af-09da-4a69-8cdc-285aa1642fc9 admin admin] PATH_INFO: `/v3/projects/b7bb1fec31fd497fa165cf9bb0eebe72/users/86d0f84bd9454cfeb452acaf1c3e7d6a/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:25.732659 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059d9af-09da-4a69-8cdc-285aa1642fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7bb1fec31fd497fa165cf9bb0eebe72, user_id=86d0f84bd9454cfeb452acaf1c3e7d6a, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:25.735344 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059d9af-09da-4a69-8cdc-285aa1642fc9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:25.753775 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1431/2851] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:25 2022] PUT /identity/v3/projects/b7bb1fec31fd497fa165cf9bb0eebe72/users/86d0f84bd9454cfeb452acaf1c3e7d6a/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:25:25.766569 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964fe1f-881d-4908-ae54-affa10033f33 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:25.766914 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964fe1f-881d-4908-ae54-affa10033f33 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:25.767224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964fe1f-881d-4908-ae54-affa10033f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:25.796211 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-6964fe1f-881d-4908-ae54-affa10033f33 None None] MFA Rules not processed for user `86d0f84bd9454cfeb452acaf1c3e7d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:25.797422 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-6964fe1f-881d-4908-ae54-affa10033f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:25.802001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:25.865669 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1421/2852] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:25.870511 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059d9af-09da-4a69-8cdc-285aa1642fc9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:25.929057 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:25.944173 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059d9af-09da-4a69-8cdc-285aa1642fc9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:25.950182 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f9fc0-0f0e-470f-8f50-91c656ae2c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:25.950884 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f9fc0-0f0e-470f-8f50-91c656ae2c1a admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:25.951164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f9fc0-0f0e-470f-8f50-91c656ae2c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:25.951436 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f9fc0-0f0e-470f-8f50-91c656ae2c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:25.952146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f9fc0-0f0e-470f-8f50-91c656ae2c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:25.954044 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f9fc0-0f0e-470f-8f50-91c656ae2c1a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:25.981852 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1432/2853] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:25:25 2022] POST /identity/v3/projects => generated 409 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:25.986013 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964fe1f-881d-4908-ae54-affa10033f33 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:25.997105 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964fe1f-881d-4908-ae54-affa10033f33 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:26.059481 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0b214-0f43-4ddf-b5c8-7b51da35307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:26.060166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0b214-0f43-4ddf-b5c8-7b51da35307a admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:26.060443 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0b214-0f43-4ddf-b5c8-7b51da35307a admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:26.060714 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0b214-0f43-4ddf-b5c8-7b51da35307a admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:26.061437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0b214-0f43-4ddf-b5c8-7b51da35307a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:26.063396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0b214-0f43-4ddf-b5c8-7b51da35307a admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:26.089518 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1422/2854] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:25:25 2022] POST /identity/v3/users => generated 311 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:25:26.093487 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f9fc0-0f0e-470f-8f50-91c656ae2c1a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:26.104453 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f9fc0-0f0e-470f-8f50-91c656ae2c1a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:26.110961 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd03e-2144-4ec0-ac09-8e26f6cdd43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:26.111637 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd03e-2144-4ec0-ac09-8e26f6cdd43e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:26.111920 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd03e-2144-4ec0-ac09-8e26f6cdd43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:26.112191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd03e-2144-4ec0-ac09-8e26f6cdd43e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:26.112923 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbd03e-2144-4ec0-ac09-8e26f6cdd43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:26.114579 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbd03e-2144-4ec0-ac09-8e26f6cdd43e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:26.125771 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1433/2855] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:26.130107 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0b214-0f43-4ddf-b5c8-7b51da35307a admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:26.140512 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0b214-0f43-4ddf-b5c8-7b51da35307a admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:26.146309 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0c014-8097-472e-9cd8-646f49f6ae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:26.147206 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0c014-8097-472e-9cd8-646f49f6ae0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:26.147517 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0c014-8097-472e-9cd8-646f49f6ae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:26.147787 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0c014-8097-472e-9cd8-646f49f6ae0a admin admin] PATH_INFO: `/v3/projects/7508ede382154b5faf1a86672b1fc84b/users/a1696b3923de4cc9aa1ac7c38761d142/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:26.163404 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0c014-8097-472e-9cd8-646f49f6ae0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7508ede382154b5faf1a86672b1fc84b, user_id=a1696b3923de4cc9aa1ac7c38761d142, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:26.166040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0c014-8097-472e-9cd8-646f49f6ae0a admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:26.181852 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1423/2856] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:26 2022] PUT /identity/v3/projects/7508ede382154b5faf1a86672b1fc84b/users/a1696b3923de4cc9aa1ac7c38761d142/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:26.186489 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd03e-2144-4ec0-ac09-8e26f6cdd43e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:26.199073 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd03e-2144-4ec0-ac09-8e26f6cdd43e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:26.260225 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903923b9-b9fe-4212-a6c2-6a21df754dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:26.260895 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903923b9-b9fe-4212-a6c2-6a21df754dfc admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:26.261176 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903923b9-b9fe-4212-a6c2-6a21df754dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:26.261449 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903923b9-b9fe-4212-a6c2-6a21df754dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:26.262179 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903923b9-b9fe-4212-a6c2-6a21df754dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:26.263875 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903923b9-b9fe-4212-a6c2-6a21df754dfc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:26.273649 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1434/2857] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:26.278090 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0c014-8097-472e-9cd8-646f49f6ae0a admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:26.288505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0c014-8097-472e-9cd8-646f49f6ae0a admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:26.293312 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb6c87-aea5-47d6-89a2-fcdbf6076175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:26.294202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb6c87-aea5-47d6-89a2-fcdbf6076175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:26.294507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb6c87-aea5-47d6-89a2-fcdbf6076175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:26.294773 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb6c87-aea5-47d6-89a2-fcdbf6076175 admin admin] PATH_INFO: `/v3/projects/7508ede382154b5faf1a86672b1fc84b/users/a1696b3923de4cc9aa1ac7c38761d142/roles/9a16cd7fa25141c181ae0defb7334ff2` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:26.296887 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb6c87-aea5-47d6-89a2-fcdbf6076175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7508ede382154b5faf1a86672b1fc84b, user_id=a1696b3923de4cc9aa1ac7c38761d142, role_id=9a16cd7fa25141c181ae0defb7334ff2)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:26.299560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb6c87-aea5-47d6-89a2-fcdbf6076175 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:26.310046 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1424/2858] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:26 2022] PUT /identity/v3/projects/7508ede382154b5faf1a86672b1fc84b/users/a1696b3923de4cc9aa1ac7c38761d142/roles/9a16cd7fa25141c181ae0defb7334ff2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:26.321380 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac45f9-f7f4-4c5c-b4cf-d5d979599194 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:26.321784 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac45f9-f7f4-4c5c-b4cf-d5d979599194 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:26.322174 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac45f9-f7f4-4c5c-b4cf-d5d979599194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:26.353091 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7aac45f9-f7f4-4c5c-b4cf-d5d979599194 None None] MFA Rules not processed for user `a1696b3923de4cc9aa1ac7c38761d142`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:26.354392 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7aac45f9-f7f4-4c5c-b4cf-d5d979599194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:26.425266 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1435/2859] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 03:25:26.437015 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb6c87-aea5-47d6-89a2-fcdbf6076175 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:26.439035 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-92eb6c87-aea5-47d6-89a2-fcdbf6076175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:26.498006 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb6c87-aea5-47d6-89a2-fcdbf6076175 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:26.504635 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426bab-e515-4994-acac-18e1af0f12e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:26.505838 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426bab-e515-4994-acac-18e1af0f12e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:26.506284 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426bab-e515-4994-acac-18e1af0f12e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:26.506763 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426bab-e515-4994-acac-18e1af0f12e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:26.522811 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13426bab-e515-4994-acac-18e1af0f12e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:26.524265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13426bab-e515-4994-acac-18e1af0f12e9 service cinder] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:26.529497 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:26.535136 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1425/2860] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:26 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:26.693888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac45f9-f7f4-4c5c-b4cf-d5d979599194 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:26.705317 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac45f9-f7f4-4c5c-b4cf-d5d979599194 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:26.709937 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de5348-6c50-4802-831c-7831c67a3078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:26.710625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de5348-6c50-4802-831c-7831c67a3078 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:26.710903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de5348-6c50-4802-831c-7831c67a3078 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:26.711169 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de5348-6c50-4802-831c-7831c67a3078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:26.758000 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:26.771008 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de5348-6c50-4802-831c-7831c67a3078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:26.772455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de5348-6c50-4802-831c-7831c67a3078 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:26.781556 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1436/2861] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:32.114178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426bab-e515-4994-acac-18e1af0f12e9 service cinder] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:32.187477 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426bab-e515-4994-acac-18e1af0f12e9 service cinder] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:32.193719 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:32.194521 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:32.194804 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:32.195081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] PATH_INFO: `/v3/users/86d0f84bd9454cfeb452acaf1c3e7d6a` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:32.196313 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d0f84bd9454cfeb452acaf1c3e7d6a)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:32.198250 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:32.250634 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d0f84bd9454cfeb452acaf1c3e7d6a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.251300 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d0f84bd9454cfeb452acaf1c3e7d6a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.258382 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d0f84bd9454cfeb452acaf1c3e7d6a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.267147 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d0f84bd9454cfeb452acaf1c3e7d6a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.280230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d0f84bd9454cfeb452acaf1c3e7d6a'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.286303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1426/2862] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:32 2022] DELETE /identity/v3/users/86d0f84bd9454cfeb452acaf1c3e7d6a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:32.291351 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059dcd9-2b5d-40c6-a228-10c2853808bc None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:32.291863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059dcd9-2b5d-40c6-a228-10c2853808bc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:32.291967 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059dcd9-2b5d-40c6-a228-10c2853808bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:32.309734 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a059dcd9-2b5d-40c6-a228-10c2853808bc None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:32.311011 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a059dcd9-2b5d-40c6-a228-10c2853808bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:32.370782 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1437/2863] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:32.380639 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:32.382323 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:32.441804 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72221509-5484-4743-9736-1b9aa4d3cd38 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:32.446469 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e998-1f03-40c8-b44c-46c55e66bfe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:32.447051 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e998-1f03-40c8-b44c-46c55e66bfe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:32.447331 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e998-1f03-40c8-b44c-46c55e66bfe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:32.447603 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e998-1f03-40c8-b44c-46c55e66bfe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:32.459971 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213e998-1f03-40c8-b44c-46c55e66bfe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:32.461410 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213e998-1f03-40c8-b44c-46c55e66bfe1 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:32.471598 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1427/2864] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:32.748048 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059dcd9-2b5d-40c6-a228-10c2853808bc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:32.749490 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a059dcd9-2b5d-40c6-a228-10c2853808bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:32.764359 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059dcd9-2b5d-40c6-a228-10c2853808bc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:32.770799 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:32.772379 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:32.772666 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:32.772939 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] PATH_INFO: `/v3/projects/b7bb1fec31fd497fa165cf9bb0eebe72` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:32.774219 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7bb1fec31fd497fa165cf9bb0eebe72)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:32.776165 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:32.827120 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7bb1fec31fd497fa165cf9bb0eebe72', 'request_id': 'req-cce39191-45d8-44f6-a007-556cee0449e1'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.833374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7bb1fec31fd497fa165cf9bb0eebe72', 'request_id': 'req-cce39191-45d8-44f6-a007-556cee0449e1'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.842116 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7bb1fec31fd497fa165cf9bb0eebe72', 'request_id': 'req-cce39191-45d8-44f6-a007-556cee0449e1'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.853365 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] The token cache is being invalidate because project b7bb1fec31fd497fa165cf9bb0eebe72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:32.853648 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.854314 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.855899 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1438/2865] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:32 2022] DELETE /identity/v3/projects/b7bb1fec31fd497fa165cf9bb0eebe72 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:32.859958 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e998-1f03-40c8-b44c-46c55e66bfe1 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:32.869898 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e998-1f03-40c8-b44c-46c55e66bfe1 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:32.888951 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:32.929644 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91807ddf-b024-4001-b487-b7d48f86e2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:32.930560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91807ddf-b024-4001-b487-b7d48f86e2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:32.930834 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91807ddf-b024-4001-b487-b7d48f86e2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:32.931113 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91807ddf-b024-4001-b487-b7d48f86e2ab admin admin] PATH_INFO: `/v3/users/a1696b3923de4cc9aa1ac7c38761d142` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:32.932286 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91807ddf-b024-4001-b487-b7d48f86e2ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1696b3923de4cc9aa1ac7c38761d142)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:32.934229 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91807ddf-b024-4001-b487-b7d48f86e2ab admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:32.988497 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-91807ddf-b024-4001-b487-b7d48f86e2ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1696b3923de4cc9aa1ac7c38761d142'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.989224 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-91807ddf-b024-4001-b487-b7d48f86e2ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1696b3923de4cc9aa1ac7c38761d142'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:32.996336 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-91807ddf-b024-4001-b487-b7d48f86e2ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1696b3923de4cc9aa1ac7c38761d142'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:33.006227 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-91807ddf-b024-4001-b487-b7d48f86e2ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1696b3923de4cc9aa1ac7c38761d142'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:33.020828 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-91807ddf-b024-4001-b487-b7d48f86e2ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1696b3923de4cc9aa1ac7c38761d142'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:33.028266 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1428/2866] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:25:32 2022] DELETE /identity/v3/users/a1696b3923de4cc9aa1ac7c38761d142 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 03:25:33.325789 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:33.328030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:33.346199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce39191-45d8-44f6-a007-556cee0449e1 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:33.416038 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:33.416924 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:33.417201 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:33.417469 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] PATH_INFO: `/v3/projects/7508ede382154b5faf1a86672b1fc84b` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:33.418806 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7508ede382154b5faf1a86672b1fc84b)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:33.420731 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:33.433164 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:33.478720 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7508ede382154b5faf1a86672b1fc84b', 'request_id': 'req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:33.485237 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7508ede382154b5faf1a86672b1fc84b', 'request_id': 'req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:33.495641 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7508ede382154b5faf1a86672b1fc84b', 'request_id': 'req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:33.506645 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] The token cache is being invalidate because project 7508ede382154b5faf1a86672b1fc84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:25:33.506927 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:33.507571 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0ff37c0d-7bb8-4d03-be40-9d75cebbcefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:25:33.509147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1439/2867] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:25:33 2022] DELETE /identity/v3/projects/7508ede382154b5faf1a86672b1fc84b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:33.514157 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73564-035c-4e34-8feb-ee43e6a036ad None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:33.514674 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73564-035c-4e34-8feb-ee43e6a036ad None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:33.514776 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73564-035c-4e34-8feb-ee43e6a036ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:33.534124 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-b1a73564-035c-4e34-8feb-ee43e6a036ad None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:33.535303 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b1a73564-035c-4e34-8feb-ee43e6a036ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:33.602651 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1429/2868] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:33.611064 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9cd6f-27fe-4f34-9c56-1a34dd6662ca None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:33.611352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9cd6f-27fe-4f34-9c56-1a34dd6662ca None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:33.611628 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9cd6f-27fe-4f34-9c56-1a34dd6662ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:33.631145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3eb9cd6f-27fe-4f34-9c56-1a34dd6662ca None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:33.632825 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3eb9cd6f-27fe-4f34-9c56-1a34dd6662ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:33.641513 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1440/2869] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:33.645870 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a73564-035c-4e34-8feb-ee43e6a036ad None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:33.656073 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a73564-035c-4e34-8feb-ee43e6a036ad None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:33.660964 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc67c7-4ab5-4845-afc8-9a0751681d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:33.661626 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc67c7-4ab5-4845-afc8-9a0751681d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:33.661907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc67c7-4ab5-4845-afc8-9a0751681d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:33.662179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc67c7-4ab5-4845-afc8-9a0751681d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:33.663018 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc67c7-4ab5-4845-afc8-9a0751681d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:25:33.663591 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc67c7-4ab5-4845-afc8-9a0751681d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:33.665259 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc67c7-4ab5-4845-afc8-9a0751681d17 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:33.677437 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1430/2870] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:25:33.681854 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9cd6f-27fe-4f34-9c56-1a34dd6662ca None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:33.691421 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9cd6f-27fe-4f34-9c56-1a34dd6662ca None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:33.697324 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e891916-5ce6-472a-8af2-832b29dabf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:33.698159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891916-5ce6-472a-8af2-832b29dabf6d admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:33.698475 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891916-5ce6-472a-8af2-832b29dabf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:33.698749 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891916-5ce6-472a-8af2-832b29dabf6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:33.699456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e891916-5ce6-472a-8af2-832b29dabf6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:33.701387 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e891916-5ce6-472a-8af2-832b29dabf6d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:33.731561 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1441/2871] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:25:33 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:25:33.737202 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc67c7-4ab5-4845-afc8-9a0751681d17 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:33.751411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc67c7-4ab5-4845-afc8-9a0751681d17 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:33.783729 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:33.819992 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0999078-4e62-49dc-bb0f-ba963e09b239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:33.820564 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0999078-4e62-49dc-bb0f-ba963e09b239 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:33.820849 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0999078-4e62-49dc-bb0f-ba963e09b239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:33.821126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0999078-4e62-49dc-bb0f-ba963e09b239 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:33.821891 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0999078-4e62-49dc-bb0f-ba963e09b239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:33.823865 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0999078-4e62-49dc-bb0f-ba963e09b239 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:33.846359 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1431/2872] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:25:33 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 03:25:33.851456 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e891916-5ce6-472a-8af2-832b29dabf6d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:33.862780 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e891916-5ce6-472a-8af2-832b29dabf6d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:33.867890 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee7dc6-ca4a-44b2-8b4f-51ded75a1ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:33.868590 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee7dc6-ca4a-44b2-8b4f-51ded75a1ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:33.868870 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee7dc6-ca4a-44b2-8b4f-51ded75a1ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:33.869145 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee7dc6-ca4a-44b2-8b4f-51ded75a1ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:33.869886 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee7dc6-ca4a-44b2-8b4f-51ded75a1ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:33.871516 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee7dc6-ca4a-44b2-8b4f-51ded75a1ed3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:33.881872 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1442/2873] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:33.885982 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0999078-4e62-49dc-bb0f-ba963e09b239 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:33.896565 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0999078-4e62-49dc-bb0f-ba963e09b239 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:33.902743 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff39d6e-5f4e-4920-823b-273413948d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:33.903445 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff39d6e-5f4e-4920-823b-273413948d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:33.903730 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff39d6e-5f4e-4920-823b-273413948d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:33.904001 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff39d6e-5f4e-4920-823b-273413948d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:33.904735 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff39d6e-5f4e-4920-823b-273413948d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:33.906328 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff39d6e-5f4e-4920-823b-273413948d9d admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:33.917179 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1432/2874] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:25:33.922502 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee7dc6-ca4a-44b2-8b4f-51ded75a1ed3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:33.933298 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee7dc6-ca4a-44b2-8b4f-51ded75a1ed3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:33.938680 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca568b1f-45b6-4220-9f74-9d69e8937594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:33.939612 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca568b1f-45b6-4220-9f74-9d69e8937594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:33.939888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca568b1f-45b6-4220-9f74-9d69e8937594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:33.940157 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca568b1f-45b6-4220-9f74-9d69e8937594 admin admin] PATH_INFO: `/v3/projects/aade9c1670904223b72c7d244891a78f/users/38b63fc34b5b4e6fbd4dfa65d9aaf7dd/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:33.956595 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca568b1f-45b6-4220-9f74-9d69e8937594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aade9c1670904223b72c7d244891a78f, user_id=38b63fc34b5b4e6fbd4dfa65d9aaf7dd, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:33.959279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca568b1f-45b6-4220-9f74-9d69e8937594 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:33.974159 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1443/2875] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:25:33 2022] PUT /identity/v3/projects/aade9c1670904223b72c7d244891a78f/users/38b63fc34b5b4e6fbd4dfa65d9aaf7dd/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:25:33.979576 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd259d2-a524-4ddd-b34d-7aaf6c16b4ad None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:33.979860 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd259d2-a524-4ddd-b34d-7aaf6c16b4ad None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:33.980130 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd259d2-a524-4ddd-b34d-7aaf6c16b4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:33.998335 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-1bd259d2-a524-4ddd-b34d-7aaf6c16b4ad None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:33.999552 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-1bd259d2-a524-4ddd-b34d-7aaf6c16b4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:34.062527 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1433/2876] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:34.072326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca568b1f-45b6-4220-9f74-9d69e8937594 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:34.074226 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ca568b1f-45b6-4220-9f74-9d69e8937594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:34.133839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca568b1f-45b6-4220-9f74-9d69e8937594 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:34.137795 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63239-98f5-4c27-8f61-0552b1ff77ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:34.138499 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63239-98f5-4c27-8f61-0552b1ff77ab service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:34.138774 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63239-98f5-4c27-8f61-0552b1ff77ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:34.139030 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63239-98f5-4c27-8f61-0552b1ff77ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:34.148363 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf63239-98f5-4c27-8f61-0552b1ff77ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:34.149786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf63239-98f5-4c27-8f61-0552b1ff77ab service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:34.159350 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1444/2877] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:34.863821 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79962-7494-4567-9f78-c2e4de6706a8 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:34.864318 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79962-7494-4567-9f78-c2e4de6706a8 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:34.864405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79962-7494-4567-9f78-c2e4de6706a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:34.894265 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-3fa79962-7494-4567-9f78-c2e4de6706a8 None None] MFA Rules not processed for user `38b63fc34b5b4e6fbd4dfa65d9aaf7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:34.895505 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-3fa79962-7494-4567-9f78-c2e4de6706a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:34.961255 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1434/2878] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:34.972195 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63239-98f5-4c27-8f61-0552b1ff77ab service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:25:34.973624 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3cf63239-98f5-4c27-8f61-0552b1ff77ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:35.017244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:35.035143 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63239-98f5-4c27-8f61-0552b1ff77ab service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:25:35.039261 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41973e5-36a9-4a99-82f5-367a7e53dc29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8a5bc11b6745a196337b4dc48de14e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:25:35.039915 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41973e5-36a9-4a99-82f5-367a7e53dc29 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:35.040191 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41973e5-36a9-4a99-82f5-367a7e53dc29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:35.040457 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41973e5-36a9-4a99-82f5-367a7e53dc29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:35.049583 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41973e5-36a9-4a99-82f5-367a7e53dc29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:25:35.051076 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41973e5-36a9-4a99-82f5-367a7e53dc29 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:25:35.062214 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1445/2879] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:25:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:25:36.453087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998da9-f2a0-49ca-a84a-33b1a341b1c6 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:36.453942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998da9-f2a0-49ca-a84a-33b1a341b1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:36.453942 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998da9-f2a0-49ca-a84a-33b1a341b1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:36.480338 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-67998da9-f2a0-49ca-a84a-33b1a341b1c6 None None] MFA Rules not processed for user `38b63fc34b5b4e6fbd4dfa65d9aaf7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:36.481545 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-67998da9-f2a0-49ca-a84a-33b1a341b1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:36.488789 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1435/2880] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:25:45.056821 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=8 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:46.473038 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:50.589552 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c414b9-c084-44f3-a739-4590137ff028 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:25:50.590056 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c414b9-c084-44f3-a739-4590137ff028 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:25:50.590056 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c414b9-c084-44f3-a739-4590137ff028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:25:50.607602 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f4c414b9-c084-44f3-a739-4590137ff028 None None] MFA Rules not processed for user `38b63fc34b5b4e6fbd4dfa65d9aaf7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:25:50.608786 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f4c414b9-c084-44f3-a739-4590137ff028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:25:50.616397 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1446/2881] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:25:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:26:00.602642 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:06.284581 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a109e-2f4d-4b5e-ad44-2143b4b3da9e None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:06.285268 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a109e-2f4d-4b5e-ad44-2143b4b3da9e None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:06.285268 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a109e-2f4d-4b5e-ad44-2143b4b3da9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:06.307345 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-b06a109e-2f4d-4b5e-ad44-2143b4b3da9e None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:26:06.308449 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b06a109e-2f4d-4b5e-ad44-2143b4b3da9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:26:06.378030 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1436/2882] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Jun 28 03:26:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:26:06.433133 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c414b9-c084-44f3-a739-4590137ff028 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:06.434726 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f4c414b9-c084-44f3-a739-4590137ff028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:26:06.508777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c414b9-c084-44f3-a739-4590137ff028 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:06.515657 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448b285-b32d-4541-9bcd-906f7cf359da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:06.516313 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448b285-b32d-4541-9bcd-906f7cf359da service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:06.516598 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448b285-b32d-4541-9bcd-906f7cf359da service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:06.516916 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448b285-b32d-4541-9bcd-906f7cf359da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:06.526588 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448b285-b32d-4541-9bcd-906f7cf359da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:06.528207 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448b285-b32d-4541-9bcd-906f7cf359da service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:06.536609 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1447/2883] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:26:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:26:16.371087 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=25 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:16.533146 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=32 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:21.008729 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7865df-9665-4cc7-b313-2ef6c4771c48 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:21.009152 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7865df-9665-4cc7-b313-2ef6c4771c48 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:21.009256 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7865df-9665-4cc7-b313-2ef6c4771c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:21.028154 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-ec7865df-9665-4cc7-b313-2ef6c4771c48 None None] MFA Rules not processed for user `a7d95e643b984955a20e48f71b204502`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:26:21.029355 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ec7865df-9665-4cc7-b313-2ef6c4771c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:26:21.037156 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1437/2884] 10.222.0.23 () {58 vars in 967 bytes} [Tue Jun 28 03:26:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:26:21.049933 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448b285-b32d-4541-9bcd-906f7cf359da service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:21.061187 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448b285-b32d-4541-9bcd-906f7cf359da service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:21.067695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408dbf-07b4-45f2-b7d9-57337eea1f2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a40d290f0e147b9b62cf3eedf399e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:21.068383 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408dbf-07b4-45f2-b7d9-57337eea1f2a service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:21.068682 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408dbf-07b4-45f2-b7d9-57337eea1f2a service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:21.068962 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408dbf-07b4-45f2-b7d9-57337eea1f2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:21.078093 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2408dbf-07b4-45f2-b7d9-57337eea1f2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:21.079856 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2408dbf-07b4-45f2-b7d9-57337eea1f2a service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:21.088830 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1448/2885] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Jun 28 03:26:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 03:26:23.044241 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7865df-9665-4cc7-b313-2ef6c4771c48 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:23.057057 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7865df-9665-4cc7-b313-2ef6c4771c48 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:23.062182 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26c1f4-3f21-4eeb-8f39-a449f2f3dcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:23.063405 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26c1f4-3f21-4eeb-8f39-a449f2f3dcc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:23.063930 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26c1f4-3f21-4eeb-8f39-a449f2f3dcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:23.064397 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26c1f4-3f21-4eeb-8f39-a449f2f3dcc4 admin admin] PATH_INFO: `/v3/users/38b63fc34b5b4e6fbd4dfa65d9aaf7dd` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:23.065905 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26c1f4-3f21-4eeb-8f39-a449f2f3dcc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b63fc34b5b4e6fbd4dfa65d9aaf7dd)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:23.068138 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26c1f4-3f21-4eeb-8f39-a449f2f3dcc4 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:23.118498 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce26c1f4-3f21-4eeb-8f39-a449f2f3dcc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b63fc34b5b4e6fbd4dfa65d9aaf7dd'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:23.119155 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce26c1f4-3f21-4eeb-8f39-a449f2f3dcc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b63fc34b5b4e6fbd4dfa65d9aaf7dd'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:23.125879 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce26c1f4-3f21-4eeb-8f39-a449f2f3dcc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b63fc34b5b4e6fbd4dfa65d9aaf7dd'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:23.134759 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce26c1f4-3f21-4eeb-8f39-a449f2f3dcc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b63fc34b5b4e6fbd4dfa65d9aaf7dd'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:23.147566 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-ce26c1f4-3f21-4eeb-8f39-a449f2f3dcc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b63fc34b5b4e6fbd4dfa65d9aaf7dd'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:23.154587 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1438/2886] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:26:23 2022] DELETE /identity/v3/users/38b63fc34b5b4e6fbd4dfa65d9aaf7dd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:26:23.346857 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408dbf-07b4-45f2-b7d9-57337eea1f2a service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:23.357627 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408dbf-07b4-45f2-b7d9-57337eea1f2a service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:23.417918 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:23.418747 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:23.419020 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:23.419285 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] PATH_INFO: `/v3/projects/aade9c1670904223b72c7d244891a78f` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:23.420445 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aade9c1670904223b72c7d244891a78f)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:23.422368 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:23.471346 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aade9c1670904223b72c7d244891a78f', 'request_id': 'req-1e755925-0823-4f5b-9d16-eab5e00bff8c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:23.477992 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aade9c1670904223b72c7d244891a78f', 'request_id': 'req-1e755925-0823-4f5b-9d16-eab5e00bff8c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:23.486972 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aade9c1670904223b72c7d244891a78f', 'request_id': 'req-1e755925-0823-4f5b-9d16-eab5e00bff8c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:23.497631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] The token cache is being invalidate because project aade9c1670904223b72c7d244891a78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:26:23.497922 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:23.498587 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1e755925-0823-4f5b-9d16-eab5e00bff8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:23.500140 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1449/2887] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:26:23 2022] DELETE /identity/v3/projects/aade9c1670904223b72c7d244891a78f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:26:23.505389 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca29d0-d03b-42cb-b707-0549a0fa96ee None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:23.505701 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca29d0-d03b-42cb-b707-0549a0fa96ee None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:23.505972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca29d0-d03b-42cb-b707-0549a0fa96ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:23.525377 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-4fca29d0-d03b-42cb-b707-0549a0fa96ee None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:26:23.526585 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-4fca29d0-d03b-42cb-b707-0549a0fa96ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:26:23.601805 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1439/2888] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:26:23.610096 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb19b8-571e-4947-96bb-3ebd7fece790 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:23.610424 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb19b8-571e-4947-96bb-3ebd7fece790 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:23.610703 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb19b8-571e-4947-96bb-3ebd7fece790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:23.631250 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4ffb19b8-571e-4947-96bb-3ebd7fece790 None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:26:23.632471 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4ffb19b8-571e-4947-96bb-3ebd7fece790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:26:23.641913 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1450/2889] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:26:23.646412 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca29d0-d03b-42cb-b707-0549a0fa96ee None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:23.656719 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca29d0-d03b-42cb-b707-0549a0fa96ee None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:23.662614 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ef5ab-c2ba-4628-a76b-6a7e3d25c148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:23.663276 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef5ab-c2ba-4628-a76b-6a7e3d25c148 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:23.663560 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef5ab-c2ba-4628-a76b-6a7e3d25c148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:23.663838 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef5ab-c2ba-4628-a76b-6a7e3d25c148 admin admin] PATH_INFO: `/v3/domains` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:23.664578 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ef5ab-c2ba-4628-a76b-6a7e3d25c148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 03:26:23.664888 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ef5ab-c2ba-4628-a76b-6a7e3d25c148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:23.666530 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ef5ab-c2ba-4628-a76b-6a7e3d25c148 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:23.680196 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1440/2890] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Jun 28 03:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 03:26:23.684656 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb19b8-571e-4947-96bb-3ebd7fece790 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:23.694188 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb19b8-571e-4947-96bb-3ebd7fece790 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:23.702695 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bd7d3-8505-4f7e-a5cf-d09aa01ae61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:23.703634 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bd7d3-8505-4f7e-a5cf-d09aa01ae61f admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:23.704021 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bd7d3-8505-4f7e-a5cf-d09aa01ae61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:23.704352 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bd7d3-8505-4f7e-a5cf-d09aa01ae61f admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:23.705410 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bd7d3-8505-4f7e-a5cf-d09aa01ae61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:23.707863 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bd7d3-8505-4f7e-a5cf-d09aa01ae61f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:23.736651 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1451/2891] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Jun 28 03:26:23 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:26:23.741296 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ef5ab-c2ba-4628-a76b-6a7e3d25c148 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:23.751972 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ef5ab-c2ba-4628-a76b-6a7e3d25c148 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:23.802903 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:23.814721 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc49e0c-d7f9-4bc6-954d-ae1a37cdb971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:23.816348 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc49e0c-d7f9-4bc6-954d-ae1a37cdb971 admin admin] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:23.816946 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc49e0c-d7f9-4bc6-954d-ae1a37cdb971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:23.817393 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc49e0c-d7f9-4bc6-954d-ae1a37cdb971 admin admin] PATH_INFO: `/v3/users` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:23.818301 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc49e0c-d7f9-4bc6-954d-ae1a37cdb971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:23.820290 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc49e0c-d7f9-4bc6-954d-ae1a37cdb971 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:23.843872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1441/2892] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Jun 28 03:26:23 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 03:26:23.848326 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bd7d3-8505-4f7e-a5cf-d09aa01ae61f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:23.859374 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bd7d3-8505-4f7e-a5cf-d09aa01ae61f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:23.864987 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2a50-0c5e-434c-8c35-c1416c9b841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:23.865660 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2a50-0c5e-434c-8c35-c1416c9b841b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:23.865938 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2a50-0c5e-434c-8c35-c1416c9b841b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:23.866212 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2a50-0c5e-434c-8c35-c1416c9b841b admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:23.866977 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c2a50-0c5e-434c-8c35-c1416c9b841b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:23.868631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c2a50-0c5e-434c-8c35-c1416c9b841b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:23.879536 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1452/2893] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:26:23.883814 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc49e0c-d7f9-4bc6-954d-ae1a37cdb971 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:23.895081 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc49e0c-d7f9-4bc6-954d-ae1a37cdb971 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:23.901166 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3d14b-e4d6-4387-9443-94439d2a6350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:23.901840 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3d14b-e4d6-4387-9443-94439d2a6350 admin admin] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:23.902126 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3d14b-e4d6-4387-9443-94439d2a6350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:23.902436 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3d14b-e4d6-4387-9443-94439d2a6350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:23.903178 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3d14b-e4d6-4387-9443-94439d2a6350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:23.904791 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3d14b-e4d6-4387-9443-94439d2a6350 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:23.916529 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1442/2894] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Jun 28 03:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 03:26:23.920690 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2a50-0c5e-434c-8c35-c1416c9b841b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:23.931941 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2a50-0c5e-434c-8c35-c1416c9b841b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:23.937603 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4cd30-3c2a-4004-97f1-91859dc5db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:23.938521 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4cd30-3c2a-4004-97f1-91859dc5db51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:23.938793 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4cd30-3c2a-4004-97f1-91859dc5db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:23.939060 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4cd30-3c2a-4004-97f1-91859dc5db51 admin admin] PATH_INFO: `/v3/projects/236e9da5259a41568e25adf304177294/users/35ab703674f849a399615a8c690662d0/roles/86e9a6602f6945d7b87811b8708df6b7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:23.953839 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4cd30-3c2a-4004-97f1-91859dc5db51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236e9da5259a41568e25adf304177294, user_id=35ab703674f849a399615a8c690662d0, role_id=86e9a6602f6945d7b87811b8708df6b7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:23.956631 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4cd30-3c2a-4004-97f1-91859dc5db51 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:23.971711 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1453/2895] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Jun 28 03:26:23 2022] PUT /identity/v3/projects/236e9da5259a41568e25adf304177294/users/35ab703674f849a399615a8c690662d0/roles/86e9a6602f6945d7b87811b8708df6b7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:26:23.982396 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4b8e6-0549-4747-8c99-de2751e2ad47 None None] REQUEST_METHOD: `POST` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:23.982698 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4b8e6-0549-4747-8c99-de2751e2ad47 None None] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:23.982976 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4b8e6-0549-4747-8c99-de2751e2ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:24.011101 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.auth.core [None req-b5b4b8e6-0549-4747-8c99-de2751e2ad47 None None] MFA Rules not processed for user `35ab703674f849a399615a8c690662d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:26:24.012344 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-b5b4b8e6-0549-4747-8c99-de2751e2ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:26:24.082899 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1443/2896] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:26:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:26:24.095147 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4cd30-3c2a-4004-97f1-91859dc5db51 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:24.097200 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-67e4cd30-3c2a-4004-97f1-91859dc5db51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:26:24.112244 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:24.161380 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4cd30-3c2a-4004-97f1-91859dc5db51 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:24.165541 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b65afa-4601-4e86-a1dc-4e028fe969ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70604923ae0b4a4dae21de1314cddbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:24.166199 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b65afa-4601-4e86-a1dc-4e028fe969ed service glance] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:24.166522 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b65afa-4601-4e86-a1dc-4e028fe969ed service glance] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:24.166778 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b65afa-4601-4e86-a1dc-4e028fe969ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:24.176430 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b65afa-4601-4e86-a1dc-4e028fe969ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:24.177991 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b65afa-4601-4e86-a1dc-4e028fe969ed service glance] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:24.187885 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1454/2897] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:26:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:26:34.079222 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:34.183625 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=20 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:45.802012 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4b8e6-0549-4747-8c99-de2751e2ad47 None None] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:45.870258 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4b8e6-0549-4747-8c99-de2751e2ad47 None None] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:45.874974 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:45.875859 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:45.876140 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:45.876403 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] PATH_INFO: `/v3/users/35ab703674f849a399615a8c690662d0` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:45.877573 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ab703674f849a399615a8c690662d0)` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:45.879514 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:45.927650 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ab703674f849a399615a8c690662d0'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:45.928302 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ab703674f849a399615a8c690662d0'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:45.935447 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ab703674f849a399615a8c690662d0'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:45.943803 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ab703674f849a399615a8c690662d0'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:45.955907 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.notifications [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ab703674f849a399615a8c690662d0'} {{(pid=80342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:45.962230 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1444/2898] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Jun 28 03:26:45 2022] DELETE /identity/v3/users/35ab703674f849a399615a8c690662d0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:26:45.967279 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cc193-66ff-4d49-9712-bcc4e95a528c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:45.967777 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cc193-66ff-4d49-9712-bcc4e95a528c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:45.967888 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cc193-66ff-4d49-9712-bcc4e95a528c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:45.985903 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-972cc193-66ff-4d49-9712-bcc4e95a528c None None] MFA Rules not processed for user `bb2a4b410c314669afc8739724443fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 03:26:45.987150 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-972cc193-66ff-4d49-9712-bcc4e95a528c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:26:46.049189 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1455/2899] 10.222.0.23 () {58 vars in 957 bytes} [Tue Jun 28 03:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 03:26:46.059099 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:46.060863 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:26:46.119040 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10832c5-f75f-4381-b70d-58a05c866f59 admin admin] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:46.123494 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbca93a-eb63-4453-a933-48b633788651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e0632bc12346b38663a0ef97ab1a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:46.124149 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbca93a-eb63-4453-a933-48b633788651 service neutron] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:46.124411 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbca93a-eb63-4453-a933-48b633788651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:46.124710 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbca93a-eb63-4453-a933-48b633788651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:46.134771 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbca93a-eb63-4453-a933-48b633788651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:46.136225 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbca93a-eb63-4453-a933-48b633788651 service neutron] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:46.145970 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1445/2900] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:26:46.442810 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cc193-66ff-4d49-9712-bcc4e95a528c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:26:46.444494 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-972cc193-66ff-4d49-9712-bcc4e95a528c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:26:46.457292 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cc193-66ff-4d49-9712-bcc4e95a528c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:26:46.463240 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2a4b410c314669afc8739724443fa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e3a42e79f984a37804898fa1c77f82d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:26:46.464142 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:26:46.464431 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:26:46.464668 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] PATH_INFO: `/v3/projects/236e9da5259a41568e25adf304177294` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:26:46.466531 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=236e9da5259a41568e25adf304177294)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:26:46.468455 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:26:46.525286 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236e9da5259a41568e25adf304177294', 'request_id': 'req-078e244e-222b-41d5-9fe4-101f0fd053d6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:46.533083 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236e9da5259a41568e25adf304177294', 'request_id': 'req-078e244e-222b-41d5-9fe4-101f0fd053d6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:46.545032 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236e9da5259a41568e25adf304177294', 'request_id': 'req-078e244e-222b-41d5-9fe4-101f0fd053d6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:46.556646 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] The token cache is being invalidate because project 236e9da5259a41568e25adf304177294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 03:26:46.556869 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:46.557496 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-078e244e-222b-41d5-9fe4-101f0fd053d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 03:26:46.559130 dv-cinder-846842-5-smb devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1456/2901] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Jun 28 03:26:46 2022] DELETE /identity/v3/projects/236e9da5259a41568e25adf304177294 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 03:26:56.141872 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:56.553369 dv-cinder-846842-5-smb devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:30:26.508507 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbca93a-eb63-4453-a933-48b633788651 service neutron] Authenticating user token {{(pid=80342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 03:30:26.510172 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-9dbca93a-eb63-4453-a933-48b633788651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:30:26.660409 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbca93a-eb63-4453-a933-48b633788651 service neutron] Validating token access rules against request {{(pid=80342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 03:30:26.723525 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb771ac-bcd7-487a-b942-ae540805d3f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8048235c6421eae12ca99f80ed5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b43ca3b00c04df2b20effc23b235e8d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 03:30:26.724168 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb771ac-bcd7-487a-b942-ae540805d3f8 service placement] REQUEST_METHOD: `GET` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 03:30:26.724452 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb771ac-bcd7-487a-b942-ae540805d3f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 03:30:26.724746 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb771ac-bcd7-487a-b942-ae540805d3f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 03:30:26.726779 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.fernet_utils [None req-ccb771ac-bcd7-487a-b942-ae540805d3f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 03:30:26.738340 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb771ac-bcd7-487a-b942-ae540805d3f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 03:30:26.739944 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb771ac-bcd7-487a-b942-ae540805d3f8 service placement] RBAC: Authorization granted {{(pid=80342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 03:30:26.750579 dv-cinder-846842-5-smb devstack@keystone.service[80342]: [pid: 80342|app: 0|req: 1446/2902] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Jun 28 03:30:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 03:30:36.745704 dv-cinder-846842-5-smb devstack@keystone.service[80342]: DEBUG dbcounter [-] [80342] Writing DB stats keystone:SELECT=89 {{(pid=80342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}